-- Logs begin at Wed 2022-07-27 19:25:04 UTC, end at Wed 2022-07-27 20:39:13 UTC. -- Jul 27 20:12:01.624709 dv-osbrick-849840-5-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 27 20:12:01.635212 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 27 20:12:01.637269 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 20:12:01 2022] *** Jul 27 20:12:01.637269 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 20:12:01.637269 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 20:12:01.637269 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: nodename: dv-osbrick-849840-5-ceph Jul 27 20:12:01.637269 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: machine: x86_64 Jul 27 20:12:01.637269 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: clock source: unix Jul 27 20:12:01.637269 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: pcre jit disabled Jul 27 20:12:01.637269 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: detected number of CPU cores: 4 Jul 27 20:12:01.637269 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: current working directory: / Jul 27 20:12:01.637269 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: detected binary path: /usr/bin/uwsgi-core Jul 27 20:12:01.637269 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: your processes number limit is 47680 Jul 27 20:12:01.637857 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: your memory page size is 4096 bytes Jul 27 20:12:01.637857 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: detected max file descriptor number: 2048 Jul 27 20:12:01.637857 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: lock engine: pthread robust mutexes Jul 27 20:12:01.637857 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: thunder lock: enabled Jul 27 20:12:01.637857 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 27 20:12:01.637857 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 20:12:01.682174 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: Python main interpreter initialized at 0x5590042359c0 Jul 27 20:12:01.682174 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: python threads support enabled Jul 27 20:12:01.682174 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: your server socket listen backlog is limited to 100 connections Jul 27 20:12:01.682174 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: your mercy for graceful operations on workers is 90 seconds Jul 27 20:12:01.682550 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 20:12:01.682628 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: *** Operational MODE: preforking *** Jul 27 20:12:01.682866 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: *** uWSGI is running in multiple interpreter mode *** Jul 27 20:12:01.682866 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: spawned uWSGI master process (pid: 87118) Jul 27 20:12:01.683106 dv-osbrick-849840-5-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 27 20:12:01.687106 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: spawned uWSGI worker 1 (pid: 87126, cores: 1) Jul 27 20:12:01.687106 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: spawned uWSGI worker 2 (pid: 87127, cores: 1) Jul 27 20:12:01.687106 dv-osbrick-849840-5-ceph devstack@keystone.service[87118]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 20:12:07.408356 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 20:12:07.408356 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: from cryptography.utils import int_from_bytes Jul 27 20:12:07.409113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 20:12:07.409113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: from cryptography.utils import int_from_bytes Jul 27 20:12:07.419738 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 20:12:07.419738 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: from cryptography.utils import int_from_bytes Jul 27 20:12:07.420209 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 20:12:07.420209 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: from cryptography.utils import int_from_bytes Jul 27 20:12:07.457927 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 20:12:07.458125 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 20:12:07.458319 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] command line args: [] {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 20:12:07.458588 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 20:12:07.458768 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ================================================================================ {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 20:12:07.459020 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] admin_token = **** {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.459296 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] config_dir = [] {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.459484 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.459666 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] config_source = [] {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.459845 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] debug = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.460053 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.461269 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.461269 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.461269 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.461269 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.461269 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] list_limit = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.461581 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] log_config_append = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.461644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.461799 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] log_dir = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.461951 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] log_file = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.462184 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.462432 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.462679 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.462926 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.463130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.463309 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.463556 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.463812 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.464033 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.464265 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.464496 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.464732 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.464977 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.465221 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.465493 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.465975 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.83/identity {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.466154 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] publish_errors = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.466384 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.466613 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.466791 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.467034 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.467166 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 20:12:07.467317 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.467430 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 20:12:07.467533 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] standard_threads = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.467612 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] command line args: [] {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 20:12:07.467764 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.467848 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 20:12:07.467966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ================================================================================ {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 20:12:07.468045 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.468168 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.468251 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] admin_token = **** {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.468862 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] use_journal = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.468963 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] config_dir = [] {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.469047 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] use_json = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.469178 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.469271 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] use_stderr = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.469343 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] config_source = [] {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.469418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] use_syslog = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.469494 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] debug = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.469575 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.469698 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.469834 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.469925 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.470071 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.470162 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.470328 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.470406 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.470565 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.470642 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.470794 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] list_limit = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.470883 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.470960 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] log_config_append = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.471031 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.471165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.471297 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.471376 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] log_dir = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.471514 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] log_file = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.471596 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.471749 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.471833 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.471998 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.472088 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.472242 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.472326 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.472475 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.472554 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.472693 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.472769 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.472844 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.472941 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.473046 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.473185 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.473275 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.473429 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.473508 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.473663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.473747 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.473917 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.473995 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.474165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.474247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.474405 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.474482 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.474639 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.474719 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.474891 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.475008 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.475175 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.475418 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.83/identity {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.475541 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.475640 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] publish_errors = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.475738 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.475834 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.475947 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.476070 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.476147 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.476264 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.476340 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.476455 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.476543 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.476649 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.476773 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.476883 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] standard_threads = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.476999 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.477121 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.477228 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.477343 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.477466 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.477541 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.477676 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] use_journal = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.477750 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.477945 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] use_json = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.478030 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.478103 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] use_stderr = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.478219 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.478294 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] use_syslog = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.478371 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.478454 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:12:07.478587 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.478672 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.478828 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.478905 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.479063 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.479175 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.479311 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.479425 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.479543 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.479622 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.479772 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.479902 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.479986 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.480103 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.480218 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.480298 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.480465 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.480552 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.480694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.480778 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.480927 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.481012 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.481156 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.481245 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.481390 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.481468 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.481624 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.481708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.481869 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.481959 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.482096 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.482175 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.482329 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.482407 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.482562 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.482641 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.482794 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.482876 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.483028 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.483153 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.483304 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.483379 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.483500 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.483578 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.483747 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.483825 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.484001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.484861 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.484955 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.485091 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.485179 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.485352 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.485430 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.485588 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.485666 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.485816 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.485893 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.486051 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.486137 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.486284 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.486361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.486551 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.486627 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.486784 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.486871 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.487018 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.487119 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.487287 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.487364 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.487524 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.487617 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.487766 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.487849 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.488000 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.488078 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.488236 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.488332 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.488470 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.488554 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.488704 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.488782 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.488935 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.489022 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.489165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.489245 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.489395 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.489481 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.489625 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.489704 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.489856 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.489934 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.490089 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.490169 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.490320 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.490404 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.490556 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.490636 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.490786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.490864 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.491020 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.491145 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.491281 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.491361 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.491515 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.491592 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.491747 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.491831 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.491980 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.492058 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.492209 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.492288 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.492439 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.492524 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.492667 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.492747 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.492900 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.492977 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.493126 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.493202 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.493365 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.493446 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.493599 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.493677 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.493836 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.493914 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.494069 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.494149 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.494327 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.494428 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.494564 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.494691 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.494778 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.494931 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.495011 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.495191 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] auth.external = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.495272 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.495425 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.495580 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.495723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.495803 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.495957 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.496035 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.496187 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] auth.password = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.496274 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.496444 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] auth.token = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.496537 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.496643 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.496722 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.496878 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.496964 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.497123 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.497212 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.497351 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.497429 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.497584 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.497661 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.497829 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.497920 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.498057 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.498135 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.498291 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.498369 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] credential.caching = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.498526 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.498606 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.498763 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.498849 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.498999 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.499104 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.499259 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.499340 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.499501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.499615 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.499760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.499841 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.500001 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.500087 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.500260 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.500355 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.500496 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.500576 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.500749 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.500829 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.501032 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.501113 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.501263 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.501374 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.501525 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.501927 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.502015 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.502135 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.502216 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.502298 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.502371 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] federation.caching = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.502453 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.502534 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.502607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.502678 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.502754 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.502916 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.502997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.503177 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.503257 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.503404 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.503484 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.503641 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.503720 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.503893 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.503975 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.504129 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.504210 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] auth.external = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.504363 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.504441 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.504607 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.504686 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.504853 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.504933 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.505096 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] identity.caching = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.505185 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] auth.password = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.505328 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] auth.token = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.505675 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.505853 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.505940 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.506088 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.506166 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.506329 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.506409 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.506559 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.506636 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.506796 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.506873 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.507031 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.507130 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.507290 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.507368 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.507528 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] credential.caching = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.507607 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.507758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.507838 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.507988 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.508067 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.508216 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.508305 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.508459 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.508540 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.508701 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.508780 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.508937 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.509016 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.509189 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.509269 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.509433 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.509513 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.509668 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.509747 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.509922 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.510005 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.510155 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.510232 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.510413 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.510558 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.510638 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.510711 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.510830 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.510913 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.511065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.511209 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.511328 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.511409 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] federation.caching = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.511574 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.511660 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.511826 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.511913 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.512056 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.512136 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.512302 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.512382 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.512548 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.512636 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.512780 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.512858 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.513025 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.513104 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.513259 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.513346 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.513486 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.513571 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.513723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.513803 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.513950 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.514042 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.514185 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.514265 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] identity.caching = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.514420 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.514554 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.514659 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.514748 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.514892 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.514972 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.515151 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.515233 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.515427 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.515517 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.515658 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.515737 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.515887 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.515965 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.516115 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.516203 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.516362 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.516443 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.516599 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.516679 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.516830 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.516917 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.517061 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.517146 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.517291 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.517375 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.517520 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.user = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.517607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.517759 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.517838 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.518013 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.518092 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.518240 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.518326 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.518485 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.518564 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.518730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.518809 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.518964 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.519051 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.519219 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.519299 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.519448 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.519527 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.519676 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.519768 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.519907 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.519985 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.520140 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.520221 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.520369 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.520456 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.520613 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.520693 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.520842 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.520920 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.521088 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.521174 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.521332 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.521412 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.521566 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.521645 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.521792 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.521879 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.522036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.522116 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.522267 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.522345 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.522498 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.522578 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.522726 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.522804 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.522955 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.523037 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.523219 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.523301 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.523461 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.523540 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.523696 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.523774 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.523932 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.524012 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.524164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.524242 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.524406 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.524485 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.524634 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.524713 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.524865 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.524945 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.525098 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.525176 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.525348 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.525427 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.525583 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.525662 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.525821 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.525899 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.526054 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.526133 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.526285 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.user = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.526365 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] resource.caching = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.526526 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.526606 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.526769 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.526849 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.527003 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.527128 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.527294 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.527383 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.527515 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.527597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.527746 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.527824 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.527982 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.528061 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.528212 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.528293 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.528446 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.528524 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.528678 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.528756 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] role.caching = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.528915 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.528996 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] role.driver = sql {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.529141 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.529220 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.529384 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.529462 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.529628 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.529708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.529870 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.529948 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.530114 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.530192 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.530356 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.530436 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.530586 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.530665 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.531330 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.531417 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.531596 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.531677 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.531824 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.531902 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.532058 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.532136 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.532292 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.532374 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.532535 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.532613 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.532780 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.532860 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.533008 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.533170 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.533250 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.533402 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.533482 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.533649 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.533738 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.533896 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.533975 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.534141 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.534220 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.534371 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.534449 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.534607 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.534686 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.534844 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.534929 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.535088 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.535170 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.535333 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.535412 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.535560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.535676 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] resource.caching = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.535788 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.535889 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.536011 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.536135 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.536263 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.536343 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.536518 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.536599 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.536764 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.536843 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.536999 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.537079 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.537233 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.537313 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.537464 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.537543 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.537699 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.537777 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] token.caching = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.537933 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.538012 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] role.caching = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.538177 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] role.driver = sql {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.538256 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.538407 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.538486 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.538654 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.538734 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.538899 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.538977 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.539161 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.539245 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.539406 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.539488 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.539647 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.539727 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.539892 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.539970 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.540126 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.540205 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.540363 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.540442 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.540591 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.540675 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.540833 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.540912 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.541077 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.541156 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.541304 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.541382 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.541544 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.541624 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.541834 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.541936 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.542092 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] database.connection = **** {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.542180 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.542334 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.542424 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.542580 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.542660 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.542818 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.542898 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.543056 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.543190 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.543316 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.543405 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.543551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.543631 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.543785 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.543874 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.544021 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.544102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.544263 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.544343 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.544498 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.544586 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.544729 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.544808 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.544960 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.545039 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.545206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.545295 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.545440 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.545520 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.545682 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.545762 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.545911 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.545999 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.546144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.546223 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.546379 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.546457 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] token.caching = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.547134 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 20:12:07.547227 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.547429 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.547668 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.547924 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.548173 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.548410 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.548654 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.548895 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.549142 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.549378 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.549616 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.549850 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.550095 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.550341 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.550570 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.550812 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.551126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.551390 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] database.connection = **** {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.551636 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.551883 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.552121 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.552362 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.552597 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.552834 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.553068 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.553304 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.553548 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.553784 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.554027 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.554262 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.554508 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.554744 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.554987 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.555242 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.555483 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.555718 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:12:07.555888 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 20:12:07.575809 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.575987 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.576215 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.580298 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.580537 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.580768 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.584574 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.590591 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.615143 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.615376 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.617358 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.617596 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.668327 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.672115 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.725254 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.725471 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.729300 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.729540 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.791536 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.791762 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.791983 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.792200 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.792421 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.792636 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.795545 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.795779 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.795998 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.796211 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.796423 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.796635 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.815693 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.815916 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.816013 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.816140 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.816226 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.816363 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.816446 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.816580 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.816665 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.816794 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.816878 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.817007 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.817099 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.817218 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.828510 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.828614 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.841080 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.841257 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.841359 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.841490 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.841578 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.841714 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.841853 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.841938 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.842012 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.842122 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.842206 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.842333 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.842424 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.842546 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 20:12:07.859654 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.859863 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 20:12:07.860201 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.860300 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.860437 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 20:12:07.860521 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 20:12:07.860654 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.860738 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.860905 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 20:12:07.860998 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.861154 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.861237 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.861406 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.861489 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.861844 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.861931 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.871056 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.871352 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.871527 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.871611 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.871798 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.871882 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.872063 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.872337 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.880839 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:07.881234 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:07.883793 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:07.884069 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.884151 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:07.884346 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.884442 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.884627 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.884711 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.884906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.884989 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.885162 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.885258 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.885426 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.885562 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.885695 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.885824 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.885963 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.886131 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.886268 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.886399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.886528 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.886665 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.886796 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.910203 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.910681 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.911704 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:07.911982 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.912193 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:07.912466 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.916583 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:07.916860 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.917093 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:07.917234 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.917366 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.917741 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.923772 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:07.924048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.924255 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:07.924531 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.928135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:07.928418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.928551 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:07.928713 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.928842 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.928993 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.929120 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.929272 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.929428 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.929652 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.929781 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.929918 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.930046 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.930170 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.930306 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.930460 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.945916 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.946047 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.946174 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.946312 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.949987 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:07.950130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:07.953783 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.954224 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.956022 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.956318 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.958470 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:07.960723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:07.961621 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:07.963920 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:07.967379 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.967761 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.968043 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.968931 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.969220 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.969605 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.970346 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.970652 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.970933 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.971351 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.971630 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.973036 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.985927 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:07.986248 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.986700 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.987185 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.989751 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:07.990043 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.990306 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.990563 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.995683 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.997433 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.997648 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.997804 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.999318 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:07.999620 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.000456 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:08.000739 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.001027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.001309 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.001584 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.005684 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:08.005965 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.006305 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.006592 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.006867 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.013172 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:08.013451 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.013728 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.014004 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.014280 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.014552 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.014832 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.020066 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:08.020343 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.020622 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.020902 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.021180 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.021451 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.021725 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.031525 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:08.034665 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:08.038001 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:08.038914 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.040414 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.040968 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:08.041929 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:08.042207 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.042487 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.045134 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.046641 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.048167 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:08.048446 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.048722 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.152527 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.153972 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:08.156937 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.157227 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.157512 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.157787 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.158056 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.159590 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:08.162431 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.162716 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.162994 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.163290 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.165726 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:08.166013 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.166295 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.171138 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:08.171437 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.171716 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.173133 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:08.173524 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.173807 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.174082 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.174353 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.174640 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.174917 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.175229 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.175506 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.175773 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.176040 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.176309 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.176571 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.176830 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.178686 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 20:12:08.178963 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.179274 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.179545 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.179813 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.180088 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.180358 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.180627 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.180895 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.181157 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.181421 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.181682 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.181941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.182197 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 20:12:08.210880 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5590042359c0 pid: 87126 (default app) Jul 27 20:12:08.214437 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8016b0-7f65-4d5d-a1b7-62eb1167743c None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:08.214729 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8016b0-7f65-4d5d-a1b7-62eb1167743c None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:08.215005 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8016b0-7f65-4d5d-a1b7-62eb1167743c None None] PATH_INFO: `/v3` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:08.216119 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5590042359c0 pid: 87127 (default app) Jul 27 20:12:08.219234 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 1/1] 10.222.0.83 () {50 vars in 791 bytes} [Wed Jul 27 20:12:08 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:16.321153 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8828c-9de6-4d82-b7c0-fa9995a95e35 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:16.321594 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8828c-9de6-4d82-b7c0-fa9995a95e35 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:16.321701 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8828c-9de6-4d82-b7c0-fa9995a95e35 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:16.326129 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 1/2] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:16.331581 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96169e8-d87d-49f6-8c8c-97ede40f6215 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:16.332013 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96169e8-d87d-49f6-8c8c-97ede40f6215 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:16.332111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96169e8-d87d-49f6-8c8c-97ede40f6215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:16.413178 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: INFO dbcounter [None req-a96169e8-d87d-49f6-8c8c-97ede40f6215 None None] Registered counter for database keystone Jul 27 20:12:16.434808 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG oslo_db.sqlalchemy.engines [None req-a96169e8-d87d-49f6-8c8c-97ede40f6215 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87126) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 20:12:16.441166 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writer thread running {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 20:12:16.613467 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG passlib.handlers.bcrypt [None req-a96169e8-d87d-49f6-8c8c-97ede40f6215 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87126) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 20:12:16.613798 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG passlib.handlers.bcrypt [None req-a96169e8-d87d-49f6-8c8c-97ede40f6215 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87126) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 20:12:16.667414 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-a96169e8-d87d-49f6-8c8c-97ede40f6215 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:16.669014 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-a96169e8-d87d-49f6-8c8c-97ede40f6215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:16.802067 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 2/3] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 27 20:12:16.953197 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8828c-9de6-4d82-b7c0-fa9995a95e35 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:17.029163 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: INFO dbcounter [None req-67d8828c-9de6-4d82-b7c0-fa9995a95e35 None None] Registered counter for database keystone Jul 27 20:12:17.049199 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG oslo_db.sqlalchemy.engines [None req-67d8828c-9de6-4d82-b7c0-fa9995a95e35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 20:12:17.055296 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writer thread running {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 20:12:17.174642 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8828c-9de6-4d82-b7c0-fa9995a95e35 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:17.179224 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae24b1-cb9a-4146-8af0-82db25109f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:17.179869 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae24b1-cb9a-4146-8af0-82db25109f17 admin admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:17.180152 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae24b1-cb9a-4146-8af0-82db25109f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:17.180426 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae24b1-cb9a-4146-8af0-82db25109f17 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:17.191461 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae24b1-cb9a-4146-8af0-82db25109f17 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:17.242710 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: WARNING keystone.common.rbac_enforcer.enforcer [None req-17ae24b1-cb9a-4146-8af0-82db25109f17 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 20:12:17.243059 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae24b1-cb9a-4146-8af0-82db25109f17 admin admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:17.253073 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 2/4] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Jul 27 20:12:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 20:12:17.259542 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96169e8-d87d-49f6-8c8c-97ede40f6215 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:17.274502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96169e8-d87d-49f6-8c8c-97ede40f6215 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:17.278915 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ee210-441c-4b71-8a2d-4599cea9b2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:17.280056 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ee210-441c-4b71-8a2d-4599cea9b2df admin admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:17.280338 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ee210-441c-4b71-8a2d-4599cea9b2df admin admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:17.280615 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ee210-441c-4b71-8a2d-4599cea9b2df admin admin] PATH_INFO: `/v3/projects/85a972f1c766490294ece49f734d7df0` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:17.282172 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ee210-441c-4b71-8a2d-4599cea9b2df admin admin] RBAC: Authorizing `identity:get_project(project_id=85a972f1c766490294ece49f734d7df0)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:17.333136 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: WARNING keystone.common.rbac_enforcer.enforcer [None req-104ee210-441c-4b71-8a2d-4599cea9b2df admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 20:12:17.333682 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ee210-441c-4b71-8a2d-4599cea9b2df admin admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:17.338225 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 3/5] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Jul 27 20:12:17 2022] GET /identity/v3/projects/85a972f1c766490294ece49f734d7df0 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:19.509162 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252db7b1-125e-4b4b-82aa-acf9d995a374 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:19.509675 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252db7b1-125e-4b4b-82aa-acf9d995a374 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:19.509675 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252db7b1-125e-4b4b-82aa-acf9d995a374 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:19.513784 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 3/6] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 20:12:19.519720 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc62a7-3992-4a47-a89c-b7615cfc2e59 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:19.520134 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc62a7-3992-4a47-a89c-b7615cfc2e59 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:19.520274 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc62a7-3992-4a47-a89c-b7615cfc2e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:19.539863 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-42fc62a7-3992-4a47-a89c-b7615cfc2e59 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:19.541371 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-42fc62a7-3992-4a47-a89c-b7615cfc2e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:19.549329 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 4/7] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 27 20:12:19.572091 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252db7b1-125e-4b4b-82aa-acf9d995a374 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:19.584457 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252db7b1-125e-4b4b-82aa-acf9d995a374 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:19.588613 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb463a-5244-40b9-be71-0ce52aaaa481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:19.589206 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb463a-5244-40b9-be71-0ce52aaaa481 admin admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:19.589484 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb463a-5244-40b9-be71-0ce52aaaa481 admin admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:19.589752 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb463a-5244-40b9-be71-0ce52aaaa481 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:19.597307 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb463a-5244-40b9-be71-0ce52aaaa481 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:19.599066 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb463a-5244-40b9-be71-0ce52aaaa481 admin admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:19.607680 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 4/8] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Jul 27 20:12:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 20:12:19.612642 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc62a7-3992-4a47-a89c-b7615cfc2e59 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:19.621503 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc62a7-3992-4a47-a89c-b7615cfc2e59 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:19.626430 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461520b-bd59-439d-8b30-380d3d1ec85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:19.627049 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461520b-bd59-439d-8b30-380d3d1ec85c admin admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:19.627357 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461520b-bd59-439d-8b30-380d3d1ec85c admin admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:19.627634 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461520b-bd59-439d-8b30-380d3d1ec85c admin admin] PATH_INFO: `/v3/users/5c55d2b6170e4e2782d526caffb1c6c0` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:19.628989 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461520b-bd59-439d-8b30-380d3d1ec85c admin admin] RBAC: Authorizing `identity:get_user(user_id=5c55d2b6170e4e2782d526caffb1c6c0)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:19.631095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461520b-bd59-439d-8b30-380d3d1ec85c admin admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:19.632617 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 5/9] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Jul 27 20:12:19 2022] GET /identity/v3/users/5c55d2b6170e4e2782d526caffb1c6c0 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:21.913309 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aea4d4-c637-413c-a3fa-84f5003d16ae None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:21.913861 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aea4d4-c637-413c-a3fa-84f5003d16ae None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:21.913861 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aea4d4-c637-413c-a3fa-84f5003d16ae None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:21.915388 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 5/10] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:21.920149 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32065ace-fd9f-4ff1-b610-5e8af7d29d3f None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:21.920537 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32065ace-fd9f-4ff1-b610-5e8af7d29d3f None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:21.921347 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32065ace-fd9f-4ff1-b610-5e8af7d29d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:21.926780 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e3fba-2af1-420d-b44a-ebe2f5081e8b None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:21.927092 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e3fba-2af1-420d-b44a-ebe2f5081e8b None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:21.927381 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e3fba-2af1-420d-b44a-ebe2f5081e8b None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:21.928656 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 6/11] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 20:12:21.933867 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c58cc-1523-44d2-83fd-b4f434a43c18 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:21.934151 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c58cc-1523-44d2-83fd-b4f434a43c18 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:21.934426 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c58cc-1523-44d2-83fd-b4f434a43c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:21.940915 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-32065ace-fd9f-4ff1-b610-5e8af7d29d3f None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:21.942111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-32065ace-fd9f-4ff1-b610-5e8af7d29d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:21.976336 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG passlib.handlers.bcrypt [None req-f61c58cc-1523-44d2-83fd-b4f434a43c18 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87127) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 20:12:21.976763 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG passlib.handlers.bcrypt [None req-f61c58cc-1523-44d2-83fd-b4f434a43c18 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87127) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 20:12:22.021812 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 6/12] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:22.022322 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-f61c58cc-1523-44d2-83fd-b4f434a43c18 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:22.023978 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-f61c58cc-1523-44d2-83fd-b4f434a43c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:22.044804 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32065ace-fd9f-4ff1-b610-5e8af7d29d3f None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:22.068134 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:22.124238 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 7/13] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 20:12:22.146092 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32065ace-fd9f-4ff1-b610-5e8af7d29d3f None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:22.149298 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c58cc-1523-44d2-83fd-b4f434a43c18 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:22.181096 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ebc84-f27e-4bea-8db0-ebd44180ddcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:22.181658 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ebc84-f27e-4bea-8db0-ebd44180ddcd None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:22.181944 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ebc84-f27e-4bea-8db0-ebd44180ddcd None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:22.182219 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ebc84-f27e-4bea-8db0-ebd44180ddcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:22.246700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c58cc-1523-44d2-83fd-b4f434a43c18 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:22.247847 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ebc84-f27e-4bea-8db0-ebd44180ddcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:22.249045 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:22.249343 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ebc84-f27e-4bea-8db0-ebd44180ddcd None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:22.273218 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:22.287166 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5e90b-2b95-463f-8f96-cbceeb35ee33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:22.288265 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5e90b-2b95-463f-8f96-cbceeb35ee33 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:22.288556 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5e90b-2b95-463f-8f96-cbceeb35ee33 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:22.288832 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5e90b-2b95-463f-8f96-cbceeb35ee33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:22.301011 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5e90b-2b95-463f-8f96-cbceeb35ee33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:12:22.309619 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-f9a5e90b-2b95-463f-8f96-cbceeb35ee33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:12:22.309619 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:12:22.309619 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:12:22.309619 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:12:22.309619 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:12:22.309619 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:12:22.309619 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:12:22.309619 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:12:22.309619 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:12:22.309619 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:12:22.309619 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:12:22.309619 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:12:22.309619 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:12:22.309619 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:12:22.309619 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:12:22.309619 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:12:22.310530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:12:22.310530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:12:22.310530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:12:22.310530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:12:22.310530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:12:22.310530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:12:22.310530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:12:22.310530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:12:22.310530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:12:22.310530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:12:22.310530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:12:22.310530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:12:22.310530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:12:22.310530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:12:22.310530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:12:22.310530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:12:22.311981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:12:22.311981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:12:22.311981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:12:22.311981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:12:22.311981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:12:22.311981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:12:22.311981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:12:22.311981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:12:22.311981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:12:22.311981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:12:22.311981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:12:22.311981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:12:22.311981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 8/14] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 27 20:12:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:12:22.317004 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5e90b-2b95-463f-8f96-cbceeb35ee33 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:22.354785 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 7/15] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:12:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 20:12:22.360526 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ebc84-f27e-4bea-8db0-ebd44180ddcd None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:22.415492 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5e90b-2b95-463f-8f96-cbceeb35ee33 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:22.452684 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616c378-9312-4e27-89fa-4ae7de73b01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:22.453231 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616c378-9312-4e27-89fa-4ae7de73b01c None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:22.453514 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616c378-9312-4e27-89fa-4ae7de73b01c None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:22.453792 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616c378-9312-4e27-89fa-4ae7de73b01c None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:22.454512 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616c378-9312-4e27-89fa-4ae7de73b01c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:22.454827 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616c378-9312-4e27-89fa-4ae7de73b01c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:22.456303 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616c378-9312-4e27-89fa-4ae7de73b01c None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:22.456913 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ebc84-f27e-4bea-8db0-ebd44180ddcd None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:22.467918 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 9/16] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:12:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:12:22.473614 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616c378-9312-4e27-89fa-4ae7de73b01c None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:22.478964 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:22.490776 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e747f7-53c5-4f5e-a2c5-ffac7f5ec9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:22.491541 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e747f7-53c5-4f5e-a2c5-ffac7f5ec9c3 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:22.491830 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e747f7-53c5-4f5e-a2c5-ffac7f5ec9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:22.492109 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e747f7-53c5-4f5e-a2c5-ffac7f5ec9c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:22.502470 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e747f7-53c5-4f5e-a2c5-ffac7f5ec9c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:22.503193 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:22.504017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e747f7-53c5-4f5e-a2c5-ffac7f5ec9c3 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:22.522776 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-e2e747f7-53c5-4f5e-a2c5-ffac7f5ec9c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:12:22.522776 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:12:22.522776 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:12:22.522776 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:12:22.522776 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:12:22.522776 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:12:22.522776 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:12:22.522776 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:12:22.522776 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:12:22.522776 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:12:22.522776 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:12:22.522776 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:12:22.522776 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:12:22.522776 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:12:22.522776 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:12:22.523773 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:12:22.523773 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:12:22.523773 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:12:22.523773 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:12:22.523773 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:12:22.523773 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:12:22.523773 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:12:22.523773 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:12:22.523773 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:12:22.523773 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:12:22.523773 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:12:22.523773 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:12:22.523773 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:12:22.523773 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:12:22.523773 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:12:22.523773 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:12:22.523773 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:12:22.524596 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:12:22.524596 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:12:22.524596 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:12:22.524596 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:12:22.524596 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 8/17] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:12:22.529647 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e747f7-53c5-4f5e-a2c5-ffac7f5ec9c3 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:22.576383 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616c378-9312-4e27-89fa-4ae7de73b01c None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:22.609498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2d87e-75f0-439f-bb49-c6e6c7e1842f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:22.610143 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2d87e-75f0-439f-bb49-c6e6c7e1842f None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:22.610454 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2d87e-75f0-439f-bb49-c6e6c7e1842f None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:22.610742 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2d87e-75f0-439f-bb49-c6e6c7e1842f None admin] PATH_INFO: `/v3/users/5c55d2b6170e4e2782d526caffb1c6c0` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:22.612298 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2d87e-75f0-439f-bb49-c6e6c7e1842f None admin] RBAC: Authorizing `identity:get_user(user_id=5c55d2b6170e4e2782d526caffb1c6c0)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:22.613903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2d87e-75f0-439f-bb49-c6e6c7e1842f None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:22.615539 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 10/18] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:12:22 2022] GET /identity/v3/users/5c55d2b6170e4e2782d526caffb1c6c0 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:12:22.620956 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2d87e-75f0-439f-bb49-c6e6c7e1842f None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:22.629401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e747f7-53c5-4f5e-a2c5-ffac7f5ec9c3 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:22.667898 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36266c33-8705-45a3-ad7a-2038da41485c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:22.668519 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36266c33-8705-45a3-ad7a-2038da41485c None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:22.668800 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36266c33-8705-45a3-ad7a-2038da41485c None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:22.669075 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36266c33-8705-45a3-ad7a-2038da41485c None admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:22.669762 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36266c33-8705-45a3-ad7a-2038da41485c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:22.670093 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36266c33-8705-45a3-ad7a-2038da41485c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:22.671528 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36266c33-8705-45a3-ad7a-2038da41485c None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:22.688650 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 9/19] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:12:22.735635 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:22.742614 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2d87e-75f0-439f-bb49-c6e6c7e1842f None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:22.786104 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbf60a-537b-4692-888a-57f3ca8b41e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:22.787146 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbf60a-537b-4692-888a-57f3ca8b41e5 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:22.787746 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbf60a-537b-4692-888a-57f3ca8b41e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:22.788201 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbf60a-537b-4692-888a-57f3ca8b41e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:22.789726 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacbf60a-537b-4692-888a-57f3ca8b41e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:22.791493 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacbf60a-537b-4692-888a-57f3ca8b41e5 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:22.793437 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 11/20] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:12:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:12:22.805937 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36266c33-8705-45a3-ad7a-2038da41485c None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:22.844276 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:22.928754 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36266c33-8705-45a3-ad7a-2038da41485c None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:22.967919 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28b8eb-8800-4df1-a712-3a76e6c1fce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:22.968554 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28b8eb-8800-4df1-a712-3a76e6c1fce0 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:22.968838 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28b8eb-8800-4df1-a712-3a76e6c1fce0 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:22.969116 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28b8eb-8800-4df1-a712-3a76e6c1fce0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:22.969907 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28b8eb-8800-4df1-a712-3a76e6c1fce0 None admin] RBAC: Adding query filter params (role.id=df8ec36d044b469d8854eba8394eb107, scope.domain.id=default, user.id=5c55d2b6170e4e2782d526caffb1c6c0) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:22.970219 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28b8eb-8800-4df1-a712-3a76e6c1fce0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:22.971767 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28b8eb-8800-4df1-a712-3a76e6c1fce0 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:22.978687 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 10/21] 10.222.0.83 () {56 vars in 1322 bytes} [Wed Jul 27 20:12:22 2022] GET /identity/v3/role_assignments?user.id=5c55d2b6170e4e2782d526caffb1c6c0&scope.domain.id=default&role.id=df8ec36d044b469d8854eba8394eb107 => generated 233 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:12:25.559795 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b117490-5648-4117-ad26-539220ea8fc7 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:25.561307 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b117490-5648-4117-ad26-539220ea8fc7 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:25.561807 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b117490-5648-4117-ad26-539220ea8fc7 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:25.563387 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 12/22] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:25.568670 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34137bef-56e9-4ee5-a4fb-50db583bec1b None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:25.569506 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34137bef-56e9-4ee5-a4fb-50db583bec1b None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:25.569986 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34137bef-56e9-4ee5-a4fb-50db583bec1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:25.596957 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-34137bef-56e9-4ee5-a4fb-50db583bec1b None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:25.598553 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-34137bef-56e9-4ee5-a4fb-50db583bec1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:25.693411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 11/23] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:25.729268 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b117490-5648-4117-ad26-539220ea8fc7 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:25.764614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a1540-b719-40ba-a0d1-01b4f9245689 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:25.764922 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a1540-b719-40ba-a0d1-01b4f9245689 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:25.765178 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a1540-b719-40ba-a0d1-01b4f9245689 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:25.766525 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 12/24] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 20:12:25.780723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c44b7b-1617-4784-8320-63e5a56e90d1 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:25.780998 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c44b7b-1617-4784-8320-63e5a56e90d1 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:25.781434 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c44b7b-1617-4784-8320-63e5a56e90d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:25.817035 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-c8c44b7b-1617-4784-8320-63e5a56e90d1 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:25.818461 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-c8c44b7b-1617-4784-8320-63e5a56e90d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:25.859499 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:25.862789 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b117490-5648-4117-ad26-539220ea8fc7 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:25.946811 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf3e26-3373-4c78-a1db-9e3703bb8af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:25.947495 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf3e26-3373-4c78-a1db-9e3703bb8af6 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:25.947778 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf3e26-3373-4c78-a1db-9e3703bb8af6 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:25.948053 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf3e26-3373-4c78-a1db-9e3703bb8af6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:25.964338 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 13/25] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 27 20:12:25.965685 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531ce09-aac6-48c0-b1bf-928a17cfa942 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:25.966270 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531ce09-aac6-48c0-b1bf-928a17cfa942 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:25.966554 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531ce09-aac6-48c0-b1bf-928a17cfa942 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:25.967906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 14/26] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:25.980020 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf3e26-3373-4c78-a1db-9e3703bb8af6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:12:25.985464 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0b346-3573-4690-86cf-b6a573e9fb89 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:25.985708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-3bdf3e26-3373-4c78-a1db-9e3703bb8af6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:12:25.985708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:12:25.985708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:12:25.985708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:12:25.985708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:12:25.985708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:12:25.985708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:12:25.985708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:12:25.985708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:12:25.985708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:12:25.985708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:12:25.985708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:12:25.985708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:12:25.985708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:12:25.985708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:12:25.985708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:12:25.986530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:12:25.986530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:12:25.986530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:12:25.986530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:12:25.986530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:12:25.986530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:12:25.986530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:12:25.986530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:12:25.986530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:12:25.986530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:12:25.986530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:12:25.986530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:12:25.986530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:12:25.986530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:12:25.986530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:12:25.986530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:12:25.987330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:12:25.987330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:12:25.987330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:12:25.987330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:12:25.987330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:12:25.987330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:12:25.987330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:12:25.987330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:12:25.987330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:12:25.987330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:12:25.987330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:12:25.987330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:12:25.987925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0b346-3573-4690-86cf-b6a573e9fb89 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:25.987925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0b346-3573-4690-86cf-b6a573e9fb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:25.988044 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 13/27] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 27 20:12:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:12:25.996195 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf3e26-3373-4c78-a1db-9e3703bb8af6 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:26.025772 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-eaa0b346-3573-4690-86cf-b6a573e9fb89 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:26.027020 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-eaa0b346-3573-4690-86cf-b6a573e9fb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:26.050697 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:26.156251 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 15/28] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 27 20:12:26.157106 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0b346-3573-4690-86cf-b6a573e9fb89 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:26.198156 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf3e26-3373-4c78-a1db-9e3703bb8af6 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:26.239976 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c15335-0920-442a-8a21-b62b8af5d043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:26.240711 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c15335-0920-442a-8a21-b62b8af5d043 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:26.241034 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c15335-0920-442a-8a21-b62b8af5d043 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:26.241375 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c15335-0920-442a-8a21-b62b8af5d043 None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:26.242148 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c15335-0920-442a-8a21-b62b8af5d043 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:26.242519 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c15335-0920-442a-8a21-b62b8af5d043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:26.244100 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c15335-0920-442a-8a21-b62b8af5d043 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:26.253208 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 14/29] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:12:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:26.253868 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c15335-0920-442a-8a21-b62b8af5d043 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:26.268066 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:26.288497 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0b346-3573-4690-86cf-b6a573e9fb89 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:26.340377 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880f3d9-f034-4a9b-8789-1022f78a282c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:26.342293 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880f3d9-f034-4a9b-8789-1022f78a282c None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:26.343525 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880f3d9-f034-4a9b-8789-1022f78a282c None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:26.343996 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880f3d9-f034-4a9b-8789-1022f78a282c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:26.360093 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880f3d9-f034-4a9b-8789-1022f78a282c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:26.362700 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880f3d9-f034-4a9b-8789-1022f78a282c None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:26.363516 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:26.381867 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c15335-0920-442a-8a21-b62b8af5d043 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:26.386191 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-8880f3d9-f034-4a9b-8789-1022f78a282c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:12:26.386191 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:12:26.386191 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:12:26.386191 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:12:26.386191 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:12:26.386191 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:12:26.386191 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:12:26.386191 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:12:26.386191 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:12:26.386191 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:12:26.386191 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:12:26.386191 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:12:26.386191 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:12:26.386191 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:12:26.386191 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:12:26.387027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:12:26.387027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:12:26.387027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:12:26.387027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:12:26.387027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:12:26.387027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:12:26.387027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:12:26.387027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:12:26.387027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:12:26.387027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:12:26.387027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:12:26.387027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:12:26.387027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:12:26.387027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:12:26.387027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:12:26.387027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:12:26.387027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:12:26.387849 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:12:26.387849 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:12:26.387849 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:12:26.387849 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:12:26.389454 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 16/30] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:12:26.391541 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320f1a3-181b-4e6b-bad1-aa17e5544866 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:26.391999 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320f1a3-181b-4e6b-bad1-aa17e5544866 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:26.392419 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320f1a3-181b-4e6b-bad1-aa17e5544866 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:26.394447 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 17/31] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:26.395710 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320f1a3-181b-4e6b-bad1-aa17e5544866 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:26.427163 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9845c-6703-4f2c-8109-2c6d7abd33c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:26.428104 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9845c-6703-4f2c-8109-2c6d7abd33c1 None admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:26.428620 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9845c-6703-4f2c-8109-2c6d7abd33c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:26.429246 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9845c-6703-4f2c-8109-2c6d7abd33c1 None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:26.430276 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9845c-6703-4f2c-8109-2c6d7abd33c1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:26.431989 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9845c-6703-4f2c-8109-2c6d7abd33c1 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:26.509259 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320f1a3-181b-4e6b-bad1-aa17e5544866 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:26.542786 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc602ca-5e88-4fb5-b6b5-45ff51995cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:26.543446 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc602ca-5e88-4fb5-b6b5-45ff51995cb4 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:26.543723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc602ca-5e88-4fb5-b6b5-45ff51995cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:26.543995 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc602ca-5e88-4fb5-b6b5-45ff51995cb4 None admin] PATH_INFO: `/v3/users/5c55d2b6170e4e2782d526caffb1c6c0` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:26.545180 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc602ca-5e88-4fb5-b6b5-45ff51995cb4 None admin] RBAC: Authorizing `identity:get_user(user_id=5c55d2b6170e4e2782d526caffb1c6c0)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:26.546602 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc602ca-5e88-4fb5-b6b5-45ff51995cb4 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:26.552904 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 18/32] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:12:26 2022] GET /identity/v3/users/5c55d2b6170e4e2782d526caffb1c6c0 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:26.552904 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc602ca-5e88-4fb5-b6b5-45ff51995cb4 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:26.564178 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:26.571136 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 15/33] 10.222.0.83 () {60 vars in 1131 bytes} [Wed Jul 27 20:12:26 2022] POST /identity/v3/roles => generated 225 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:12:26.572759 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbeaa73-342c-4ea0-864a-abcfde6d4437 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:26.573076 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbeaa73-342c-4ea0-864a-abcfde6d4437 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:26.573346 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbeaa73-342c-4ea0-864a-abcfde6d4437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:26.605968 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-7fbeaa73-342c-4ea0-864a-abcfde6d4437 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:26.608508 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-7fbeaa73-342c-4ea0-864a-abcfde6d4437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:26.675413 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc602ca-5e88-4fb5-b6b5-45ff51995cb4 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:26.689932 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 16/34] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:26.691435 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f5bc3-0c44-4098-a48e-cefb8603e5a0 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:26.691690 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f5bc3-0c44-4098-a48e-cefb8603e5a0 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:26.691978 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f5bc3-0c44-4098-a48e-cefb8603e5a0 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:26.693443 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 17/35] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:26.694259 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f5bc3-0c44-4098-a48e-cefb8603e5a0 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:26.729037 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4c395-ed6d-45e7-b701-a82bcbc3359d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:26.730042 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4c395-ed6d-45e7-b701-a82bcbc3359d None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:26.730514 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4c395-ed6d-45e7-b701-a82bcbc3359d None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:26.731154 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4c395-ed6d-45e7-b701-a82bcbc3359d None admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:26.732264 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4c395-ed6d-45e7-b701-a82bcbc3359d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:26.732859 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4c395-ed6d-45e7-b701-a82bcbc3359d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:26.734665 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4c395-ed6d-45e7-b701-a82bcbc3359d None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:26.749102 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 19/36] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:26.750768 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1c863-aa0a-4fa5-9ef9-09553ae6e9ad None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:26.751339 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1c863-aa0a-4fa5-9ef9-09553ae6e9ad None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:26.751825 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1c863-aa0a-4fa5-9ef9-09553ae6e9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:26.772418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-53c1c863-aa0a-4fa5-9ef9-09553ae6e9ad None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:26.773936 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-53c1c863-aa0a-4fa5-9ef9-09553ae6e9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:26.797526 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:26.826152 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f5bc3-0c44-4098-a48e-cefb8603e5a0 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:26.850153 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:26.856319 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 20/37] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:26.857317 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1c863-aa0a-4fa5-9ef9-09553ae6e9ad None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:26.872205 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c303fad-1ec3-4b65-9a6c-014969a88ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:26.874262 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c303fad-1ec3-4b65-9a6c-014969a88ca2 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:26.874883 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c303fad-1ec3-4b65-9a6c-014969a88ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:26.875385 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c303fad-1ec3-4b65-9a6c-014969a88ca2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:26.877426 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c303fad-1ec3-4b65-9a6c-014969a88ca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:26.879267 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c303fad-1ec3-4b65-9a6c-014969a88ca2 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:26.881985 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 18/38] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:12:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:26.882835 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c303fad-1ec3-4b65-9a6c-014969a88ca2 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:26.967859 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1c863-aa0a-4fa5-9ef9-09553ae6e9ad None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:26.992603 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c303fad-1ec3-4b65-9a6c-014969a88ca2 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:27.002488 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2b2de-a5b3-4b8c-9844-918e837c0e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:27.003132 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2b2de-a5b3-4b8c-9844-918e837c0e3b None admin] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:27.003419 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2b2de-a5b3-4b8c-9844-918e837c0e3b None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:27.003690 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2b2de-a5b3-4b8c-9844-918e837c0e3b None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:27.004778 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2b2de-a5b3-4b8c-9844-918e837c0e3b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:27.006166 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2b2de-a5b3-4b8c-9844-918e837c0e3b None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:27.031395 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66e3a0-f740-4a85-b0a3-493e68971c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:27.032044 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66e3a0-f740-4a85-b0a3-493e68971c8e None admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:27.032336 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66e3a0-f740-4a85-b0a3-493e68971c8e None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:27.032617 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66e3a0-f740-4a85-b0a3-493e68971c8e None admin] PATH_INFO: `/v3/projects` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:27.033322 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66e3a0-f740-4a85-b0a3-493e68971c8e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:27.034820 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66e3a0-f740-4a85-b0a3-493e68971c8e None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:27.061078 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:27.077198 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 19/39] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Jul 27 20:12:26 2022] POST /identity/v3/projects => generated 301 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:12:27.078157 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66e3a0-f740-4a85-b0a3-493e68971c8e None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:27.135263 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 21/40] 10.222.0.83 () {60 vars in 1131 bytes} [Wed Jul 27 20:12:26 2022] POST /identity/v3/roles => generated 219 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:12:27.136048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2b2de-a5b3-4b8c-9844-918e837c0e3b None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:27.228850 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:27.238422 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66e3a0-f740-4a85-b0a3-493e68971c8e None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:27.281143 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2b2de-a5b3-4b8c-9844-918e837c0e3b None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:27.284611 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d1269-a8c7-46bd-a015-9ab5e3058e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:27.285387 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d1269-a8c7-46bd-a015-9ab5e3058e75 None admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:27.285789 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d1269-a8c7-46bd-a015-9ab5e3058e75 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:27.286142 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d1269-a8c7-46bd-a015-9ab5e3058e75 None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:27.287029 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d1269-a8c7-46bd-a015-9ab5e3058e75 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:27.288692 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d1269-a8c7-46bd-a015-9ab5e3058e75 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:27.321821 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 20/41] 10.222.0.83 () {60 vars in 1131 bytes} [Wed Jul 27 20:12:27 2022] POST /identity/v3/roles => generated 223 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:12:27.322913 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306aac0-277d-42d7-9c8a-ffa9ee690435 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:27.324129 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306aac0-277d-42d7-9c8a-ffa9ee690435 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:27.324129 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306aac0-277d-42d7-9c8a-ffa9ee690435 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:27.326657 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 21/42] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:27.330137 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848158c-b2d9-4ee1-b011-8ad6b7940be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:27.331374 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848158c-b2d9-4ee1-b011-8ad6b7940be1 None admin] REQUEST_METHOD: `PUT` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:27.331864 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848158c-b2d9-4ee1-b011-8ad6b7940be1 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:27.332342 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848158c-b2d9-4ee1-b011-8ad6b7940be1 None admin] PATH_INFO: `/v3/domains/default/users/5c55d2b6170e4e2782d526caffb1c6c0/roles/df8ec36d044b469d8854eba8394eb107` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:27.332902 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060b1ad-fd14-4fb0-b423-3dd84b183408 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:27.333263 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060b1ad-fd14-4fb0-b423-3dd84b183408 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:27.333646 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060b1ad-fd14-4fb0-b423-3dd84b183408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:27.335682 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848158c-b2d9-4ee1-b011-8ad6b7940be1 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5c55d2b6170e4e2782d526caffb1c6c0, role_id=df8ec36d044b469d8854eba8394eb107)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:27.337638 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848158c-b2d9-4ee1-b011-8ad6b7940be1 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:27.358565 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 22/43] 10.222.0.83 () {58 vars in 1361 bytes} [Wed Jul 27 20:12:27 2022] PUT /identity/v3/domains/default/users/5c55d2b6170e4e2782d526caffb1c6c0/roles/df8ec36d044b469d8854eba8394eb107 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:12:27.360840 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-5060b1ad-fd14-4fb0-b423-3dd84b183408 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:27.360840 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-5060b1ad-fd14-4fb0-b423-3dd84b183408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:27.431425 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:27.454268 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 22/44] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:27.478973 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848158c-b2d9-4ee1-b011-8ad6b7940be1 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:27.600331 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848158c-b2d9-4ee1-b011-8ad6b7940be1 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:27.619110 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:27.636958 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d6367-708d-40c6-96e3-245a281ebb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:27.637611 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d6367-708d-40c6-96e3-245a281ebb89 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:27.637894 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d6367-708d-40c6-96e3-245a281ebb89 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:27.638172 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d6367-708d-40c6-96e3-245a281ebb89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:27.639488 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d6367-708d-40c6-96e3-245a281ebb89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:27.640966 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d6367-708d-40c6-96e3-245a281ebb89 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:27.642592 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 23/45] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:12:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:27.648148 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060b1ad-fd14-4fb0-b423-3dd84b183408 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:27.749493 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060b1ad-fd14-4fb0-b423-3dd84b183408 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:27.783661 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bbcb3-663e-4b09-8494-aa234a0a6da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:27.784302 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bbcb3-663e-4b09-8494-aa234a0a6da6 None admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:27.784591 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bbcb3-663e-4b09-8494-aa234a0a6da6 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:27.784868 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bbcb3-663e-4b09-8494-aa234a0a6da6 None admin] PATH_INFO: `/v3/projects` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:27.785544 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17bbcb3-663e-4b09-8494-aa234a0a6da6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:27.787007 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17bbcb3-663e-4b09-8494-aa234a0a6da6 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:27.813616 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 23/46] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Jul 27 20:12:27 2022] POST /identity/v3/projects => generated 312 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 20:12:29.611029 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a35d6-1359-4726-b7a0-443de26650ca None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:29.611573 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a35d6-1359-4726-b7a0-443de26650ca None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:29.611573 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a35d6-1359-4726-b7a0-443de26650ca None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:29.612896 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 24/47] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:29.618029 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb579b-1a86-4307-99dc-c20d1644c85e None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:29.618441 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb579b-1a86-4307-99dc-c20d1644c85e None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:29.618588 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb579b-1a86-4307-99dc-c20d1644c85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:29.636513 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-b2eb579b-1a86-4307-99dc-c20d1644c85e None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:29.637776 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-b2eb579b-1a86-4307-99dc-c20d1644c85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:29.666557 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:29.709882 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 24/48] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:29.734382 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a35d6-1359-4726-b7a0-443de26650ca None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:29.836370 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a35d6-1359-4726-b7a0-443de26650ca None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:29.868638 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cafc1c-b228-4880-95f9-0ff5ce543dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:29.869219 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cafc1c-b228-4880-95f9-0ff5ce543dd7 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:29.869499 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cafc1c-b228-4880-95f9-0ff5ce543dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:29.869773 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cafc1c-b228-4880-95f9-0ff5ce543dd7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:29.883956 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cafc1c-b228-4880-95f9-0ff5ce543dd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:12:29.890820 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-d4cafc1c-b228-4880-95f9-0ff5ce543dd7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:12:29.890820 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:12:29.890820 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:12:29.890820 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:12:29.890820 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:12:29.890820 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:12:29.890820 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:12:29.890820 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:12:29.890820 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:12:29.890820 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:12:29.890820 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:12:29.890820 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:12:29.890820 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:12:29.890820 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:12:29.890820 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:12:29.890820 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:12:29.891768 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:12:29.891768 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:12:29.891768 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:12:29.891768 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:12:29.891768 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:12:29.891768 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:12:29.891768 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:12:29.891768 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:12:29.891768 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:12:29.891768 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:12:29.891768 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:12:29.891768 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:12:29.891768 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:12:29.891768 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:12:29.891768 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:12:29.891768 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:12:29.893465 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:12:29.893465 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:12:29.893465 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:12:29.893465 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:12:29.893465 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:12:29.893465 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:12:29.893465 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:12:29.893465 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:12:29.893465 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:12:29.893465 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:12:29.893465 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:12:29.893465 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:12:29.893465 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 25/49] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 27 20:12:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:12:29.899990 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb579b-1a86-4307-99dc-c20d1644c85e None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:29.997457 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb579b-1a86-4307-99dc-c20d1644c85e None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:30.025969 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca2106-b938-415c-83f0-5a3c3d9325a0 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:30.026257 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca2106-b938-415c-83f0-5a3c3d9325a0 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:30.026543 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca2106-b938-415c-83f0-5a3c3d9325a0 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:30.027932 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 26/50] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 20:12:30.032306 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbd4a8-9fd3-4faa-ba3d-769cc5c89c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:30.032936 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbd4a8-9fd3-4faa-ba3d-769cc5c89c28 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:30.033023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03d1cd-e91b-484e-972a-5bb220edb4f1 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:30.033221 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbd4a8-9fd3-4faa-ba3d-769cc5c89c28 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:30.033316 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03d1cd-e91b-484e-972a-5bb220edb4f1 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:30.033500 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbd4a8-9fd3-4faa-ba3d-769cc5c89c28 None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:30.033592 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03d1cd-e91b-484e-972a-5bb220edb4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:30.034216 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbd4a8-9fd3-4faa-ba3d-769cc5c89c28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:30.034523 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbd4a8-9fd3-4faa-ba3d-769cc5c89c28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:30.035936 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbd4a8-9fd3-4faa-ba3d-769cc5c89c28 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:30.044450 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 25/51] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:12:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:30.049960 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbd4a8-9fd3-4faa-ba3d-769cc5c89c28 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:30.051309 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-6c03d1cd-e91b-484e-972a-5bb220edb4f1 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:30.052858 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-6c03d1cd-e91b-484e-972a-5bb220edb4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:30.077946 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:30.097071 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:30.121275 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 27/52] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 20:12:30.145899 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03d1cd-e91b-484e-972a-5bb220edb4f1 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:30.152410 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbd4a8-9fd3-4faa-ba3d-769cc5c89c28 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:30.185635 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882595b-39ba-4e90-ad6d-b0203abfbaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:30.186283 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882595b-39ba-4e90-ad6d-b0203abfbaa6 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:30.186576 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882595b-39ba-4e90-ad6d-b0203abfbaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:30.186849 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882595b-39ba-4e90-ad6d-b0203abfbaa6 None admin] PATH_INFO: `/v3/users/5c55d2b6170e4e2782d526caffb1c6c0` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:30.188073 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882595b-39ba-4e90-ad6d-b0203abfbaa6 None admin] RBAC: Authorizing `identity:get_user(user_id=5c55d2b6170e4e2782d526caffb1c6c0)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:30.189506 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882595b-39ba-4e90-ad6d-b0203abfbaa6 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:30.191339 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 26/53] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:12:30 2022] GET /identity/v3/users/5c55d2b6170e4e2782d526caffb1c6c0 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:12:30.196554 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882595b-39ba-4e90-ad6d-b0203abfbaa6 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:30.244601 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03d1cd-e91b-484e-972a-5bb220edb4f1 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:30.277661 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ccbec-666a-4d27-a63d-624ec2a4c428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:30.278296 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ccbec-666a-4d27-a63d-624ec2a4c428 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:30.278584 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ccbec-666a-4d27-a63d-624ec2a4c428 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:30.278860 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ccbec-666a-4d27-a63d-624ec2a4c428 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:30.280162 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ccbec-666a-4d27-a63d-624ec2a4c428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:30.281618 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ccbec-666a-4d27-a63d-624ec2a4c428 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:30.283220 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 28/54] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:12:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:12:30.288603 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:30.288763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ccbec-666a-4d27-a63d-624ec2a4c428 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:30.295394 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882595b-39ba-4e90-ad6d-b0203abfbaa6 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:30.333865 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0225f3c-aa4e-43ab-b776-637444d6a0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:30.334518 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0225f3c-aa4e-43ab-b776-637444d6a0ba None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:30.334803 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0225f3c-aa4e-43ab-b776-637444d6a0ba None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:30.335100 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0225f3c-aa4e-43ab-b776-637444d6a0ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:30.336284 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0225f3c-aa4e-43ab-b776-637444d6a0ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:30.336518 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:30.337713 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0225f3c-aa4e-43ab-b776-637444d6a0ba None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:30.339342 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 27/55] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:12:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:12:30.345082 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0225f3c-aa4e-43ab-b776-637444d6a0ba None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:30.391798 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ccbec-666a-4d27-a63d-624ec2a4c428 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:30.424274 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda0606-1655-468a-a40f-767fa78845f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:30.424916 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda0606-1655-468a-a40f-767fa78845f0 None admin] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:30.425206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda0606-1655-468a-a40f-767fa78845f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:30.425482 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda0606-1655-468a-a40f-767fa78845f0 None admin] PATH_INFO: `/v3/projects` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:30.426153 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda0606-1655-468a-a40f-767fa78845f0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:30.427656 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda0606-1655-468a-a40f-767fa78845f0 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:30.442808 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0225f3c-aa4e-43ab-b776-637444d6a0ba None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:30.456696 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 29/56] 10.222.0.83 () {60 vars in 1140 bytes} [Wed Jul 27 20:12:30 2022] POST /identity/v3/projects => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 20:12:30.478480 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b8b17-a179-4f04-ba5a-fdfb898505e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:30.479220 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b8b17-a179-4f04-ba5a-fdfb898505e1 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:30.479509 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b8b17-a179-4f04-ba5a-fdfb898505e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:30.479786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b8b17-a179-4f04-ba5a-fdfb898505e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:30.480594 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b8b17-a179-4f04-ba5a-fdfb898505e1 None admin] RBAC: Adding query filter params (role.id=df8ec36d044b469d8854eba8394eb107, scope.domain.id=default, user.id=5c55d2b6170e4e2782d526caffb1c6c0) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:30.480906 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b8b17-a179-4f04-ba5a-fdfb898505e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:30.482961 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b8b17-a179-4f04-ba5a-fdfb898505e1 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:30.493595 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 28/57] 10.222.0.83 () {56 vars in 1322 bytes} [Wed Jul 27 20:12:30 2022] GET /identity/v3/role_assignments?user.id=5c55d2b6170e4e2782d526caffb1c6c0&scope.domain.id=default&role.id=df8ec36d044b469d8854eba8394eb107 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:12:32.687578 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf919d-0cc2-455e-a596-f8ee978036a7 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:32.688078 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf919d-0cc2-455e-a596-f8ee978036a7 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:32.688078 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf919d-0cc2-455e-a596-f8ee978036a7 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:32.689411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 30/58] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:32.694687 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402f80f-d90e-4568-a6e4-07ab7648fd6a None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:32.695047 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402f80f-d90e-4568-a6e4-07ab7648fd6a None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:32.695295 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402f80f-d90e-4568-a6e4-07ab7648fd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:32.713296 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-4402f80f-d90e-4568-a6e4-07ab7648fd6a None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:32.714483 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-4402f80f-d90e-4568-a6e4-07ab7648fd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:32.737268 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:32.782249 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 29/59] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:32.807381 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf919d-0cc2-455e-a596-f8ee978036a7 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:32.905538 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:32.913217 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf919d-0cc2-455e-a596-f8ee978036a7 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:32.945334 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386efcc0-0780-48b4-a1f3-bf1633c53344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:32.945905 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386efcc0-0780-48b4-a1f3-bf1633c53344 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:32.946187 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386efcc0-0780-48b4-a1f3-bf1633c53344 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:32.946458 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386efcc0-0780-48b4-a1f3-bf1633c53344 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:32.947625 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386efcc0-0780-48b4-a1f3-bf1633c53344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:32.949074 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386efcc0-0780-48b4-a1f3-bf1633c53344 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:32.951252 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 31/60] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:12:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:32.956796 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402f80f-d90e-4568-a6e4-07ab7648fd6a None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:33.051753 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402f80f-d90e-4568-a6e4-07ab7648fd6a None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:33.085277 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bbb21-721d-43da-8b1a-42aacb9404db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:33.085886 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bbb21-721d-43da-8b1a-42aacb9404db None admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:33.086172 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bbb21-721d-43da-8b1a-42aacb9404db None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:33.086450 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bbb21-721d-43da-8b1a-42aacb9404db None admin] PATH_INFO: `/v3/users` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:33.087162 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5bbb21-721d-43da-8b1a-42aacb9404db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:33.088604 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5bbb21-721d-43da-8b1a-42aacb9404db None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:33.114173 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 30/61] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 27 20:12:32 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:12:36.590345 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7fc94-2b1e-4027-8b41-2ed3d10d4116 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:36.591406 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7fc94-2b1e-4027-8b41-2ed3d10d4116 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:36.591909 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7fc94-2b1e-4027-8b41-2ed3d10d4116 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:36.593549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 32/62] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:36.599235 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2289b05-9922-4f4c-8615-817e78b8e289 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:36.600119 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2289b05-9922-4f4c-8615-817e78b8e289 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:36.600608 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2289b05-9922-4f4c-8615-817e78b8e289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:36.628101 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-a2289b05-9922-4f4c-8615-817e78b8e289 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:36.629909 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-a2289b05-9922-4f4c-8615-817e78b8e289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:36.643363 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:36.722132 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e367a8-351a-49da-8aa4-8adcaa9f4e7e None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:36.722759 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e367a8-351a-49da-8aa4-8adcaa9f4e7e None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:36.723262 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e367a8-351a-49da-8aa4-8adcaa9f4e7e None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:36.724811 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 33/63] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:36.729690 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded5ac2-1563-4c43-af81-34690fe610c1 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:36.730197 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded5ac2-1563-4c43-af81-34690fe610c1 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:36.730677 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded5ac2-1563-4c43-af81-34690fe610c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:36.730792 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 31/64] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:36.755293 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2289b05-9922-4f4c-8615-817e78b8e289 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:36.761154 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-1ded5ac2-1563-4c43-af81-34690fe610c1 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:36.762373 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-1ded5ac2-1563-4c43-af81-34690fe610c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:36.859793 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2289b05-9922-4f4c-8615-817e78b8e289 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:36.895996 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 34/65] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 20:12:36.923096 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3b0ab-e43f-4894-8e34-a2bf9e4728e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:36.924191 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3b0ab-e43f-4894-8e34-a2bf9e4728e8 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:36.924679 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3b0ab-e43f-4894-8e34-a2bf9e4728e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:36.925175 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3b0ab-e43f-4894-8e34-a2bf9e4728e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:36.948670 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3b0ab-e43f-4894-8e34-a2bf9e4728e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:12:36.954712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-6fc3b0ab-e43f-4894-8e34-a2bf9e4728e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:12:36.954712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:12:36.954712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:12:36.954712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:12:36.954712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:12:36.954712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:12:36.954712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:12:36.954712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:12:36.954712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:12:36.954712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:12:36.954712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:12:36.954712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:12:36.954712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:12:36.954712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:12:36.954712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:12:36.954712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:12:36.955606 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:12:36.955606 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:12:36.955606 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:12:36.955606 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:12:36.955606 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:12:36.955606 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:12:36.955606 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:12:36.955606 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:12:36.955606 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:12:36.955606 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:12:36.955606 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:12:36.955606 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:12:36.955606 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:12:36.955606 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:12:36.955606 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:12:36.955606 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:12:36.956377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:12:36.956377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:12:36.956377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:12:36.956377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:12:36.956377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:12:36.956377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:12:36.956377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:12:36.956377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:12:36.956377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:12:36.956377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:12:36.956377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:12:36.956377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:12:36.958732 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 32/66] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:12:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:12:36.964883 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded5ac2-1563-4c43-af81-34690fe610c1 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:36.973986 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3b0ab-e43f-4894-8e34-a2bf9e4728e8 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:36.983427 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:37.091350 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:37.098547 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded5ac2-1563-4c43-af81-34690fe610c1 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:37.105196 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3b0ab-e43f-4894-8e34-a2bf9e4728e8 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:37.133266 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177f7fb-7767-4d32-8edc-e5cd388ba27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:37.133826 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177f7fb-7767-4d32-8edc-e5cd388ba27f None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:37.134110 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177f7fb-7767-4d32-8edc-e5cd388ba27f None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:37.134393 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177f7fb-7767-4d32-8edc-e5cd388ba27f None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:37.135138 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177f7fb-7767-4d32-8edc-e5cd388ba27f None admin] RBAC: Adding query filter params (name=member) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:37.135452 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177f7fb-7767-4d32-8edc-e5cd388ba27f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:37.136847 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177f7fb-7767-4d32-8edc-e5cd388ba27f None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:37.139234 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f8bae-b416-4777-85ff-ab8175f0d400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:37.139872 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f8bae-b416-4777-85ff-ab8175f0d400 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:37.140160 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f8bae-b416-4777-85ff-ab8175f0d400 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:37.140435 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f8bae-b416-4777-85ff-ab8175f0d400 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:37.148532 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 35/67] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:12:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:37.150367 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f8bae-b416-4777-85ff-ab8175f0d400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:12:37.154278 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81ebac-1d40-4ad8-a6ae-f1aebbcd9da8 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:37.154570 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81ebac-1d40-4ad8-a6ae-f1aebbcd9da8 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:37.154852 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81ebac-1d40-4ad8-a6ae-f1aebbcd9da8 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:37.155498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-439f8bae-b416-4777-85ff-ab8175f0d400 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:12:37.155498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:12:37.155498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:12:37.155498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:12:37.155498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:12:37.155498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:12:37.155498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:12:37.155498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:12:37.155498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:12:37.155498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:12:37.155498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:12:37.155498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:12:37.155498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:12:37.155498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:12:37.155498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:12:37.155498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:12:37.156361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:12:37.156361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:12:37.156361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:12:37.156361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:12:37.156361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:12:37.156361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:12:37.156361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:12:37.156361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:12:37.156361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:12:37.156361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:12:37.156361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:12:37.156361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:12:37.156361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:12:37.156361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:12:37.156361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:12:37.156361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:12:37.162051 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:12:37.162051 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:12:37.162051 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:12:37.162051 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:12:37.162051 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:12:37.162051 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:12:37.162051 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:12:37.162051 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:12:37.162051 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:12:37.162051 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:12:37.162051 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:12:37.162051 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:12:37.162644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 36/68] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:37.162712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 33/69] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 27 20:12:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:12:37.162712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb051718-6f94-41ac-8438-50f6ca327458 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:37.162712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb051718-6f94-41ac-8438-50f6ca327458 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:37.162712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb051718-6f94-41ac-8438-50f6ca327458 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:37.162712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 34/70] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:37.162981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce4603-e191-4bc3-aaf0-f0e339acc643 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:37.162981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce4603-e191-4bc3-aaf0-f0e339acc643 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:37.163138 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb051718-6f94-41ac-8438-50f6ca327458 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:37.163206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce4603-e191-4bc3-aaf0-f0e339acc643 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:37.167119 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 37/71] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:37.167119 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ad2dc-91da-48bf-a6bf-1b3244a4a652 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:37.167119 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ad2dc-91da-48bf-a6bf-1b3244a4a652 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:37.167119 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ad2dc-91da-48bf-a6bf-1b3244a4a652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:37.186702 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-975ad2dc-91da-48bf-a6bf-1b3244a4a652 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:37.187943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-975ad2dc-91da-48bf-a6bf-1b3244a4a652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:37.228266 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:37.255741 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 38/72] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:37.256582 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ad2dc-91da-48bf-a6bf-1b3244a4a652 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:37.267737 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb051718-6f94-41ac-8438-50f6ca327458 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:37.306952 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a878a9-e03a-4cb8-88be-c3af9d131630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:37.307637 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a878a9-e03a-4cb8-88be-c3af9d131630 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:37.307920 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a878a9-e03a-4cb8-88be-c3af9d131630 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:37.308197 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a878a9-e03a-4cb8-88be-c3af9d131630 None admin] PATH_INFO: `/v3/users/5f1e12dbf11d4d17913d66e0e88d33c8` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:37.326479 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a878a9-e03a-4cb8-88be-c3af9d131630 None admin] RBAC: Authorizing `identity:get_user(user_id=5f1e12dbf11d4d17913d66e0e88d33c8)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:37.328017 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a878a9-e03a-4cb8-88be-c3af9d131630 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:37.329703 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 35/73] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:12:37 2022] GET /identity/v3/users/5f1e12dbf11d4d17913d66e0e88d33c8 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:37.330876 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3ffa0-988d-4a41-a92a-f80e2a2a837b None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:37.331201 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3ffa0-988d-4a41-a92a-f80e2a2a837b None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:37.331481 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3ffa0-988d-4a41-a92a-f80e2a2a837b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:37.351522 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-46c3ffa0-988d-4a41-a92a-f80e2a2a837b None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:37.352737 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-46c3ffa0-988d-4a41-a92a-f80e2a2a837b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:37.354166 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:37.369927 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ad2dc-91da-48bf-a6bf-1b3244a4a652 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:37.402800 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8403f-31eb-4494-92ff-ee0d1c5eb738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:37.403904 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8403f-31eb-4494-92ff-ee0d1c5eb738 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:37.404191 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8403f-31eb-4494-92ff-ee0d1c5eb738 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:37.404470 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8403f-31eb-4494-92ff-ee0d1c5eb738 None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:37.405187 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8403f-31eb-4494-92ff-ee0d1c5eb738 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:37.405496 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8403f-31eb-4494-92ff-ee0d1c5eb738 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:37.406889 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8403f-31eb-4494-92ff-ee0d1c5eb738 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:37.414784 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 39/74] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:12:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:37.419713 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 36/75] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:37.420632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3ffa0-988d-4a41-a92a-f80e2a2a837b None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:37.421172 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6524fa-d5cc-424d-89de-db2a0c0ed679 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:37.421466 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6524fa-d5cc-424d-89de-db2a0c0ed679 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:37.421751 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6524fa-d5cc-424d-89de-db2a0c0ed679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:37.438887 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-9e6524fa-d5cc-424d-89de-db2a0c0ed679 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:37.440109 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-9e6524fa-d5cc-424d-89de-db2a0c0ed679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:37.484223 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:37.504780 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 40/76] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:37.505608 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6524fa-d5cc-424d-89de-db2a0c0ed679 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:37.538546 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3ffa0-988d-4a41-a92a-f80e2a2a837b None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:37.572738 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20477d19-857a-4b01-bdfe-a592616f3472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:37.573382 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20477d19-857a-4b01-bdfe-a592616f3472 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:37.573666 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20477d19-857a-4b01-bdfe-a592616f3472 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:37.573942 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20477d19-857a-4b01-bdfe-a592616f3472 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:37.580939 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:37.584006 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20477d19-857a-4b01-bdfe-a592616f3472 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:12:37.588996 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-20477d19-857a-4b01-bdfe-a592616f3472 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:12:37.588996 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:12:37.588996 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:12:37.588996 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:12:37.588996 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:12:37.588996 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:12:37.588996 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:12:37.588996 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:12:37.588996 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:12:37.588996 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:12:37.588996 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:12:37.588996 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:12:37.588996 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:12:37.588996 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:12:37.588996 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:12:37.588996 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:12:37.589855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:12:37.589855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:12:37.589855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:12:37.589855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:12:37.589855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:12:37.589855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:12:37.589855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:12:37.589855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:12:37.589855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:12:37.589855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:12:37.589855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:12:37.589855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:12:37.589855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:12:37.589855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:12:37.589855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:12:37.589855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:12:37.590646 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:12:37.590646 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:12:37.590646 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:12:37.590646 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:12:37.590646 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:12:37.590646 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:12:37.590646 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:12:37.590646 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:12:37.590646 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:12:37.590646 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:12:37.590646 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:12:37.590646 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:12:37.590646 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 37/77] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:12:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:12:37.591850 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20477d19-857a-4b01-bdfe-a592616f3472 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:37.603768 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6524fa-d5cc-424d-89de-db2a0c0ed679 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:37.637943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a73b0-2a90-4d14-b3be-57a34cc43c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:37.638649 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a73b0-2a90-4d14-b3be-57a34cc43c15 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:37.638934 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a73b0-2a90-4d14-b3be-57a34cc43c15 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:37.639239 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a73b0-2a90-4d14-b3be-57a34cc43c15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:37.690699 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20477d19-857a-4b01-bdfe-a592616f3472 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:37.704644 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:37.705897 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a73b0-2a90-4d14-b3be-57a34cc43c15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:37.707414 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a73b0-2a90-4d14-b3be-57a34cc43c15 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:37.726857 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c67478-325b-4991-8de1-ad397cdb76a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:37.727531 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c67478-325b-4991-8de1-ad397cdb76a7 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:37.727819 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c67478-325b-4991-8de1-ad397cdb76a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:37.728095 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c67478-325b-4991-8de1-ad397cdb76a7 None admin] PATH_INFO: `/v3/users/5c55d2b6170e4e2782d526caffb1c6c0` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:37.729283 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c67478-325b-4991-8de1-ad397cdb76a7 None admin] RBAC: Authorizing `identity:get_user(user_id=5c55d2b6170e4e2782d526caffb1c6c0)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:37.730725 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c67478-325b-4991-8de1-ad397cdb76a7 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:37.732389 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 38/78] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:12:37 2022] GET /identity/v3/users/5c55d2b6170e4e2782d526caffb1c6c0 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:37.733145 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c67478-325b-4991-8de1-ad397cdb76a7 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:37.788794 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:37.810715 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 41/79] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:12:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:37.811866 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a73b0-2a90-4d14-b3be-57a34cc43c15 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:37.839655 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c67478-325b-4991-8de1-ad397cdb76a7 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:37.874779 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0f4d1-cebc-40a5-8ff3-59497cfaac34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:37.875455 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0f4d1-cebc-40a5-8ff3-59497cfaac34 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:37.875754 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0f4d1-cebc-40a5-8ff3-59497cfaac34 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:37.876013 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0f4d1-cebc-40a5-8ff3-59497cfaac34 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:37.886373 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0f4d1-cebc-40a5-8ff3-59497cfaac34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:12:37.892260 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-7ae0f4d1-cebc-40a5-8ff3-59497cfaac34 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 20:12:37.892260 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:12:37.892260 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:12:37.892260 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:12:37.892260 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:12:37.892260 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:12:37.892260 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:12:37.892260 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:12:37.892260 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:12:37.892260 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:12:37.892260 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:12:37.892260 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:12:37.892260 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:12:37.892260 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:12:37.892260 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:12:37.892260 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:12:37.893087 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:12:37.893087 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:12:37.893087 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:12:37.893087 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:12:37.893087 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:12:37.893087 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:12:37.893087 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:12:37.893087 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:12:37.893087 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:12:37.893087 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:12:37.893087 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:12:37.893087 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:12:37.893087 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:12:37.893087 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:12:37.893087 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:12:37.893087 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:12:37.894038 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:12:37.894038 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:12:37.894038 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:12:37.894038 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:12:37.894038 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:12:37.894038 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:12:37.894038 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:12:37.894038 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:12:37.894038 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:12:37.894038 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:12:37.894038 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 20:12:37.894038 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:12:37.894038 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 39/80] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 27 20:12:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:12:37.895993 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0f4d1-cebc-40a5-8ff3-59497cfaac34 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:37.915333 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a73b0-2a90-4d14-b3be-57a34cc43c15 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:37.937430 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:37.949408 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dfaeb-3160-4caa-8eaf-56727b6e7afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:37.949976 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dfaeb-3160-4caa-8eaf-56727b6e7afd None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:37.950750 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dfaeb-3160-4caa-8eaf-56727b6e7afd None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:37.951021 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dfaeb-3160-4caa-8eaf-56727b6e7afd None admin] PATH_INFO: `/v3/domains/default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:37.952191 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5dfaeb-3160-4caa-8eaf-56727b6e7afd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:37.953633 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5dfaeb-3160-4caa-8eaf-56727b6e7afd None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:37.955213 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 42/81] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:12:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:37.955968 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dfaeb-3160-4caa-8eaf-56727b6e7afd None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:37.995745 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0f4d1-cebc-40a5-8ff3-59497cfaac34 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:38.001218 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:38.030979 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a269e-b54e-43c2-adfb-941651818782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:38.031633 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a269e-b54e-43c2-adfb-941651818782 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:38.031910 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a269e-b54e-43c2-adfb-941651818782 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:38.032186 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a269e-b54e-43c2-adfb-941651818782 None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:38.032908 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a269e-b54e-43c2-adfb-941651818782 None admin] RBAC: Adding query filter params (name=member) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:38.033215 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a269e-b54e-43c2-adfb-941651818782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:38.034590 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a269e-b54e-43c2-adfb-941651818782 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:38.042528 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 40/82] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:12:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:38.043348 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a269e-b54e-43c2-adfb-941651818782 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:38.053942 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dfaeb-3160-4caa-8eaf-56727b6e7afd None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:38.088852 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d078419-7796-4763-8d14-0eef4e009999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:38.089547 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d078419-7796-4763-8d14-0eef4e009999 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:38.089835 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d078419-7796-4763-8d14-0eef4e009999 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:38.090115 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d078419-7796-4763-8d14-0eef4e009999 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:38.144945 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a269e-b54e-43c2-adfb-941651818782 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:38.146421 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:38.157028 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d078419-7796-4763-8d14-0eef4e009999 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:38.158500 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d078419-7796-4763-8d14-0eef4e009999 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:38.178426 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ba38a-8386-4ed0-9139-e5e2150dd1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:38.179096 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ba38a-8386-4ed0-9139-e5e2150dd1c4 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:38.179382 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ba38a-8386-4ed0-9139-e5e2150dd1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:38.179662 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ba38a-8386-4ed0-9139-e5e2150dd1c4 None admin] PATH_INFO: `/v3/projects/d40f8877192d4e139c6e3bd259c38e25` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:38.180841 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ba38a-8386-4ed0-9139-e5e2150dd1c4 None admin] RBAC: Authorizing `identity:get_project(project_id=d40f8877192d4e139c6e3bd259c38e25)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:38.182275 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ba38a-8386-4ed0-9139-e5e2150dd1c4 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:38.184204 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 41/83] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:12:38 2022] GET /identity/v3/projects/d40f8877192d4e139c6e3bd259c38e25 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:38.185231 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ba38a-8386-4ed0-9139-e5e2150dd1c4 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:38.210066 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:38.264310 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 43/84] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:12:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:38.265844 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d078419-7796-4763-8d14-0eef4e009999 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:38.287036 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ba38a-8386-4ed0-9139-e5e2150dd1c4 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:38.321855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07193398-a3d8-4edb-9930-1d9447dfddbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:38.322477 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07193398-a3d8-4edb-9930-1d9447dfddbe None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:38.322756 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07193398-a3d8-4edb-9930-1d9447dfddbe None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:38.323030 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07193398-a3d8-4edb-9930-1d9447dfddbe None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:38.323770 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07193398-a3d8-4edb-9930-1d9447dfddbe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:38.324074 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07193398-a3d8-4edb-9930-1d9447dfddbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:38.326040 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07193398-a3d8-4edb-9930-1d9447dfddbe None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:38.334046 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 42/85] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:12:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:38.334046 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07193398-a3d8-4edb-9930-1d9447dfddbe None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:38.364995 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:38.368097 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d078419-7796-4763-8d14-0eef4e009999 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:38.402218 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87220e08-78a1-4e63-b1d2-fb0973d13d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:38.402837 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87220e08-78a1-4e63-b1d2-fb0973d13d0b None admin] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:38.403146 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87220e08-78a1-4e63-b1d2-fb0973d13d0b None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:38.403425 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87220e08-78a1-4e63-b1d2-fb0973d13d0b None admin] PATH_INFO: `/v3/users` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:38.404123 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87220e08-78a1-4e63-b1d2-fb0973d13d0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:38.405552 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87220e08-78a1-4e63-b1d2-fb0973d13d0b None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:38.432423 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 44/86] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 27 20:12:38 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:12:38.435302 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07193398-a3d8-4edb-9930-1d9447dfddbe None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:38.440132 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87220e08-78a1-4e63-b1d2-fb0973d13d0b None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:38.443899 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:38.478474 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd396b-a7bd-47d0-848d-0b07be3a28c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:38.479539 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd396b-a7bd-47d0-848d-0b07be3a28c8 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:38.482831 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd396b-a7bd-47d0-848d-0b07be3a28c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:38.483138 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd396b-a7bd-47d0-848d-0b07be3a28c8 None admin] PATH_INFO: `/v3/users/5f1e12dbf11d4d17913d66e0e88d33c8` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:38.484492 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd396b-a7bd-47d0-848d-0b07be3a28c8 None admin] RBAC: Authorizing `identity:get_user(user_id=5f1e12dbf11d4d17913d66e0e88d33c8)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:38.485996 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd396b-a7bd-47d0-848d-0b07be3a28c8 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:38.490674 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 43/87] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:12:38 2022] GET /identity/v3/users/5f1e12dbf11d4d17913d66e0e88d33c8 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:38.490674 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd396b-a7bd-47d0-848d-0b07be3a28c8 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:38.568723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87220e08-78a1-4e63-b1d2-fb0973d13d0b None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:38.605660 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:38.610565 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd396b-a7bd-47d0-848d-0b07be3a28c8 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:38.610726 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418d3b2-846a-4d04-97ea-fe49a0e822b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:38.610726 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418d3b2-846a-4d04-97ea-fe49a0e822b2 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:38.611441 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418d3b2-846a-4d04-97ea-fe49a0e822b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:38.611441 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418d3b2-846a-4d04-97ea-fe49a0e822b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:38.612048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418d3b2-846a-4d04-97ea-fe49a0e822b2 None admin] RBAC: Adding query filter params (role.id=13a38ce5696549bf95272ffae43798c8, scope.project.id=d40f8877192d4e139c6e3bd259c38e25, user.id=5f1e12dbf11d4d17913d66e0e88d33c8) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:38.613230 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418d3b2-846a-4d04-97ea-fe49a0e822b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:38.614714 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418d3b2-846a-4d04-97ea-fe49a0e822b2 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:38.623743 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 45/88] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:12:38 2022] GET /identity/v3/role_assignments?user.id=5f1e12dbf11d4d17913d66e0e88d33c8&scope.project.id=d40f8877192d4e139c6e3bd259c38e25&role.id=13a38ce5696549bf95272ffae43798c8 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:38.624393 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418d3b2-846a-4d04-97ea-fe49a0e822b2 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:38.652962 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc373a-92d7-4acf-955b-8744dcfdf402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:38.653845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc373a-92d7-4acf-955b-8744dcfdf402 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:38.654257 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc373a-92d7-4acf-955b-8744dcfdf402 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:38.654546 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc373a-92d7-4acf-955b-8744dcfdf402 None admin] PATH_INFO: `/v3/projects/d40f8877192d4e139c6e3bd259c38e25` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:38.656008 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc373a-92d7-4acf-955b-8744dcfdf402 None admin] RBAC: Authorizing `identity:get_project(project_id=d40f8877192d4e139c6e3bd259c38e25)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:38.657553 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc373a-92d7-4acf-955b-8744dcfdf402 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:38.659689 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 44/89] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:12:38 2022] GET /identity/v3/projects/d40f8877192d4e139c6e3bd259c38e25 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:38.660620 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc373a-92d7-4acf-955b-8744dcfdf402 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:38.707393 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:38.758522 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418d3b2-846a-4d04-97ea-fe49a0e822b2 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:38.801495 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc373a-92d7-4acf-955b-8744dcfdf402 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:38.804271 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc74f6-4f6a-428c-8462-4a2127e0e6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:38.805183 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc74f6-4f6a-428c-8462-4a2127e0e6a1 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:38.805646 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc74f6-4f6a-428c-8462-4a2127e0e6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:38.806100 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc74f6-4f6a-428c-8462-4a2127e0e6a1 None admin] PATH_INFO: `/v3/users/5f1e12dbf11d4d17913d66e0e88d33c8` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:38.807587 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc74f6-4f6a-428c-8462-4a2127e0e6a1 None admin] RBAC: Authorizing `identity:get_user(user_id=5f1e12dbf11d4d17913d66e0e88d33c8)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:38.811284 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc74f6-4f6a-428c-8462-4a2127e0e6a1 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:38.813539 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 46/90] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:12:38 2022] GET /identity/v3/users/5f1e12dbf11d4d17913d66e0e88d33c8 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:38.814536 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc74f6-4f6a-428c-8462-4a2127e0e6a1 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:38.849334 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47fbe2-11a3-431a-9418-c687a82bbea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:38.849979 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47fbe2-11a3-431a-9418-c687a82bbea7 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:38.850265 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47fbe2-11a3-431a-9418-c687a82bbea7 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:38.852564 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47fbe2-11a3-431a-9418-c687a82bbea7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:38.894999 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:38.935871 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47fbe2-11a3-431a-9418-c687a82bbea7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:38.937648 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47fbe2-11a3-431a-9418-c687a82bbea7 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:38.950379 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc74f6-4f6a-428c-8462-4a2127e0e6a1 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:38.986441 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f81d30-e6af-428a-a5c4-5ccbad19c277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:38.987539 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f81d30-e6af-428a-a5c4-5ccbad19c277 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:38.987829 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f81d30-e6af-428a-a5c4-5ccbad19c277 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:38.988156 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f81d30-e6af-428a-a5c4-5ccbad19c277 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:38.989232 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f81d30-e6af-428a-a5c4-5ccbad19c277 None admin] RBAC: Adding query filter params (role.id=df8ec36d044b469d8854eba8394eb107, scope.project.id=d40f8877192d4e139c6e3bd259c38e25, user.id=5c55d2b6170e4e2782d526caffb1c6c0) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:38.989546 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f81d30-e6af-428a-a5c4-5ccbad19c277 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:38.991199 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f81d30-e6af-428a-a5c4-5ccbad19c277 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:38.993432 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:39.000377 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 47/91] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:12:38 2022] GET /identity/v3/role_assignments?user.id=5c55d2b6170e4e2782d526caffb1c6c0&scope.project.id=d40f8877192d4e139c6e3bd259c38e25&role.id=df8ec36d044b469d8854eba8394eb107 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:39.001637 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f81d30-e6af-428a-a5c4-5ccbad19c277 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:39.058436 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 45/92] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:12:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:39.064096 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47fbe2-11a3-431a-9418-c687a82bbea7 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:39.136536 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f81d30-e6af-428a-a5c4-5ccbad19c277 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:39.186584 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4b04f-44b8-4b6a-9b13-9ed9bff6bb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:39.190444 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4b04f-44b8-4b6a-9b13-9ed9bff6bb6f None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:39.190444 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4b04f-44b8-4b6a-9b13-9ed9bff6bb6f None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:39.190444 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4b04f-44b8-4b6a-9b13-9ed9bff6bb6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:39.233673 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:39.291178 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:39.295855 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c4b04f-44b8-4b6a-9b13-9ed9bff6bb6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:39.298093 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c4b04f-44b8-4b6a-9b13-9ed9bff6bb6f None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:39.336110 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47fbe2-11a3-431a-9418-c687a82bbea7 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:39.418339 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796bd60-4b78-48c9-8a88-12491b7133d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:39.419040 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796bd60-4b78-48c9-8a88-12491b7133d5 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:39.419354 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796bd60-4b78-48c9-8a88-12491b7133d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:39.419639 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796bd60-4b78-48c9-8a88-12491b7133d5 None admin] PATH_INFO: `/v3/projects/10a079b1209640c8afb55201224df5a7` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:39.424027 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796bd60-4b78-48c9-8a88-12491b7133d5 None admin] RBAC: Authorizing `identity:get_project(project_id=10a079b1209640c8afb55201224df5a7)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:39.425503 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796bd60-4b78-48c9-8a88-12491b7133d5 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:39.427229 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 46/93] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:12:39 2022] GET /identity/v3/projects/10a079b1209640c8afb55201224df5a7 => generated 312 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:39.431208 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 48/94] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:12:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:39.437620 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796bd60-4b78-48c9-8a88-12491b7133d5 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:39.438867 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4b04f-44b8-4b6a-9b13-9ed9bff6bb6f None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:39.649641 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796bd60-4b78-48c9-8a88-12491b7133d5 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:39.664982 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:39.669039 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4b04f-44b8-4b6a-9b13-9ed9bff6bb6f None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:39.722395 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420428ac-8247-439c-8ec5-84539c9f9f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:39.723392 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420428ac-8247-439c-8ec5-84539c9f9f50 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:39.723908 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420428ac-8247-439c-8ec5-84539c9f9f50 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:39.724385 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420428ac-8247-439c-8ec5-84539c9f9f50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:39.725380 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420428ac-8247-439c-8ec5-84539c9f9f50 None admin] RBAC: Adding query filter params (role.id=13a38ce5696549bf95272ffae43798c8, scope.project.id=10a079b1209640c8afb55201224df5a7, user.id=5f1e12dbf11d4d17913d66e0e88d33c8) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:39.725909 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420428ac-8247-439c-8ec5-84539c9f9f50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:39.727581 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420428ac-8247-439c-8ec5-84539c9f9f50 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:39.730597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1dede-d59d-4b7c-adcb-fe4e0abad3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:39.731335 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1dede-d59d-4b7c-adcb-fe4e0abad3e3 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:39.731629 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1dede-d59d-4b7c-adcb-fe4e0abad3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:39.731745 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:39.731901 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1dede-d59d-4b7c-adcb-fe4e0abad3e3 None admin] PATH_INFO: `/v3/projects/d40f8877192d4e139c6e3bd259c38e25` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:39.735906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1dede-d59d-4b7c-adcb-fe4e0abad3e3 None admin] RBAC: Authorizing `identity:get_project(project_id=d40f8877192d4e139c6e3bd259c38e25)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:39.738339 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1dede-d59d-4b7c-adcb-fe4e0abad3e3 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:39.740730 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 47/95] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:12:39 2022] GET /identity/v3/role_assignments?user.id=5f1e12dbf11d4d17913d66e0e88d33c8&scope.project.id=10a079b1209640c8afb55201224df5a7&role.id=13a38ce5696549bf95272ffae43798c8 => generated 259 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:39.742503 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 49/96] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:12:39 2022] GET /identity/v3/projects/d40f8877192d4e139c6e3bd259c38e25 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:39.749364 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420428ac-8247-439c-8ec5-84539c9f9f50 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:39.886972 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420428ac-8247-439c-8ec5-84539c9f9f50 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:39.932861 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf822f49-2051-446e-8d52-9e21ff1995b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:39.933469 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf822f49-2051-446e-8d52-9e21ff1995b1 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:39.933753 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf822f49-2051-446e-8d52-9e21ff1995b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:39.934033 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf822f49-2051-446e-8d52-9e21ff1995b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:39.935500 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf822f49-2051-446e-8d52-9e21ff1995b1 None admin] RBAC: Adding query filter params (role.id=b63f862c45f24bd8856021d73b8fa0e2, scope.project.id=d40f8877192d4e139c6e3bd259c38e25, user.id=5f1e12dbf11d4d17913d66e0e88d33c8) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:39.935822 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf822f49-2051-446e-8d52-9e21ff1995b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:39.937380 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf822f49-2051-446e-8d52-9e21ff1995b1 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:39.943878 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 48/97] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:12:39 2022] GET /identity/v3/role_assignments?user.id=5f1e12dbf11d4d17913d66e0e88d33c8&scope.project.id=d40f8877192d4e139c6e3bd259c38e25&role.id=b63f862c45f24bd8856021d73b8fa0e2 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:41.703623 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c5391-0494-46c8-a267-517eb3fa2790 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:41.704602 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c5391-0494-46c8-a267-517eb3fa2790 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:41.705109 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c5391-0494-46c8-a267-517eb3fa2790 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:41.706666 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 50/98] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:41.712375 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692055a-19b0-48c2-9589-9252945c5acf None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:41.712859 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692055a-19b0-48c2-9589-9252945c5acf None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:41.712930 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692055a-19b0-48c2-9589-9252945c5acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:41.736621 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-4692055a-19b0-48c2-9589-9252945c5acf None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:41.737829 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-4692055a-19b0-48c2-9589-9252945c5acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:41.829229 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:41.837395 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 49/99] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:41.857538 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631de73-cf6b-42cc-8ca1-0af9dfc5e700 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:41.858805 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631de73-cf6b-42cc-8ca1-0af9dfc5e700 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:41.859781 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631de73-cf6b-42cc-8ca1-0af9dfc5e700 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:41.863087 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 51/100] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:41.869706 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa38536-2927-41a5-afef-f6cc04a0b95e None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:41.870244 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa38536-2927-41a5-afef-f6cc04a0b95e None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:41.870726 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa38536-2927-41a5-afef-f6cc04a0b95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:41.884089 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631de73-cf6b-42cc-8ca1-0af9dfc5e700 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:41.912571 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-8aa38536-2927-41a5-afef-f6cc04a0b95e None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:41.914904 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-8aa38536-2927-41a5-afef-f6cc04a0b95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:42.042519 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 50/101] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:42.066972 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631de73-cf6b-42cc-8ca1-0af9dfc5e700 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:42.098073 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa38536-2927-41a5-afef-f6cc04a0b95e None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:42.126633 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec4561-e026-425c-bf71-6899a9d21623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:42.127321 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec4561-e026-425c-bf71-6899a9d21623 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:42.127603 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec4561-e026-425c-bf71-6899a9d21623 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:42.127879 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec4561-e026-425c-bf71-6899a9d21623 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:42.150750 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec4561-e026-425c-bf71-6899a9d21623 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:12:42.156701 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-b4ec4561-e026-425c-bf71-6899a9d21623 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:12:42.156701 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:12:42.156701 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:12:42.156701 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:12:42.156701 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:12:42.156701 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:12:42.156701 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:12:42.156701 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:12:42.156701 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:12:42.156701 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:12:42.156701 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:12:42.156701 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:12:42.156701 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:12:42.156701 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:12:42.156701 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:12:42.156701 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:12:42.157522 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:12:42.157522 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:12:42.157522 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:12:42.157522 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:12:42.157522 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:12:42.157522 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:12:42.157522 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:12:42.157522 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:12:42.157522 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:12:42.157522 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:12:42.157522 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:12:42.157522 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:12:42.157522 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:12:42.157522 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:12:42.157522 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:12:42.157522 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:12:42.158295 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:12:42.158295 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:12:42.158295 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:12:42.158295 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:12:42.158295 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:12:42.158295 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:12:42.158295 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:12:42.158295 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:12:42.158295 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:12:42.158295 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:12:42.158295 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:12:42.158295 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:12:42.161764 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 52/102] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:12:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:12:42.167630 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec4561-e026-425c-bf71-6899a9d21623 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:42.233936 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:42.281016 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa38536-2927-41a5-afef-f6cc04a0b95e None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:42.329652 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:42.350362 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261786c-3c2d-4394-badc-526d81ca5a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:42.351010 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261786c-3c2d-4394-badc-526d81ca5a2d None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:42.351422 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261786c-3c2d-4394-badc-526d81ca5a2d None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:42.351586 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261786c-3c2d-4394-badc-526d81ca5a2d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:42.368376 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261786c-3c2d-4394-badc-526d81ca5a2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:12:42.373322 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-9261786c-3c2d-4394-badc-526d81ca5a2d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 20:12:42.373322 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:12:42.373322 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:12:42.373322 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:12:42.373322 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:12:42.373322 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:12:42.373322 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:12:42.373322 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:12:42.373322 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:12:42.373322 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:12:42.373322 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:12:42.373322 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:12:42.373322 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:12:42.373322 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:12:42.373322 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:12:42.373322 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:12:42.374148 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:12:42.374148 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:12:42.374148 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:12:42.374148 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:12:42.374148 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:12:42.374148 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:12:42.374148 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:12:42.374148 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:12:42.374148 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:12:42.374148 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:12:42.374148 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:12:42.374148 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:12:42.374148 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:12:42.374148 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:12:42.374148 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:12:42.374148 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:12:42.375341 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:12:42.375341 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:12:42.375341 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:12:42.375341 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:12:42.375341 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:12:42.375341 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:12:42.375341 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:12:42.375341 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:12:42.375341 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:12:42.375341 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:12:42.375341 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 20:12:42.375341 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:12:42.375341 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 51/103] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:12:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:12:42.376152 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ae65b-2cce-47d2-a515-78bd389a37d8 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:42.383277 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec4561-e026-425c-bf71-6899a9d21623 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:42.384859 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ae65b-2cce-47d2-a515-78bd389a37d8 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:42.385993 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ae65b-2cce-47d2-a515-78bd389a37d8 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:42.392531 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 52/104] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:42 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:42.393320 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ae65b-2cce-47d2-a515-78bd389a37d8 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:42.442358 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183de45-4b7e-48a5-a2fc-71bc26f48bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:42.443096 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183de45-4b7e-48a5-a2fc-71bc26f48bf1 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:42.443385 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183de45-4b7e-48a5-a2fc-71bc26f48bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:42.443662 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183de45-4b7e-48a5-a2fc-71bc26f48bf1 None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:42.444369 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183de45-4b7e-48a5-a2fc-71bc26f48bf1 None admin] RBAC: Adding query filter params (name=member) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:42.444672 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183de45-4b7e-48a5-a2fc-71bc26f48bf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:42.446065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183de45-4b7e-48a5-a2fc-71bc26f48bf1 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:42.461955 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 53/105] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:12:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:42.468056 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed38d0-7a51-4a87-8d26-3ea3824aea0d None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:42.468367 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed38d0-7a51-4a87-8d26-3ea3824aea0d None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:42.468649 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed38d0-7a51-4a87-8d26-3ea3824aea0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:42.498699 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-dbed38d0-7a51-4a87-8d26-3ea3824aea0d None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:42.500401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-dbed38d0-7a51-4a87-8d26-3ea3824aea0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:42.549886 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ae65b-2cce-47d2-a515-78bd389a37d8 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:42.571035 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 54/106] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:42.572144 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed38d0-7a51-4a87-8d26-3ea3824aea0d None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:42.599740 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:42.603326 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8755d23-b67a-454f-8bff-ef9aad6ebee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:42.603989 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8755d23-b67a-454f-8bff-ef9aad6ebee4 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:42.604306 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8755d23-b67a-454f-8bff-ef9aad6ebee4 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:42.604555 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8755d23-b67a-454f-8bff-ef9aad6ebee4 None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:42.605315 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8755d23-b67a-454f-8bff-ef9aad6ebee4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:42.605630 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8755d23-b67a-454f-8bff-ef9aad6ebee4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:42.612997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8755d23-b67a-454f-8bff-ef9aad6ebee4 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:42.618938 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 53/107] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:12:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:42.620294 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8843c5-cdd5-4bf5-aa3e-218de4c134e4 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:42.620587 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8843c5-cdd5-4bf5-aa3e-218de4c134e4 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:42.620869 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8843c5-cdd5-4bf5-aa3e-218de4c134e4 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:42.622632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 54/108] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:42.627375 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8843c5-cdd5-4bf5-aa3e-218de4c134e4 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:42.677349 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:42.692362 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed38d0-7a51-4a87-8d26-3ea3824aea0d None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:42.728730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bb927-d488-4a55-97df-dacbcc3994b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:42.730218 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bb927-d488-4a55-97df-dacbcc3994b1 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:42.730670 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bb927-d488-4a55-97df-dacbcc3994b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:42.731221 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bb927-d488-4a55-97df-dacbcc3994b1 None admin] PATH_INFO: `/v3/users/5f1e12dbf11d4d17913d66e0e88d33c8` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:42.732595 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bb927-d488-4a55-97df-dacbcc3994b1 None admin] RBAC: Authorizing `identity:get_user(user_id=5f1e12dbf11d4d17913d66e0e88d33c8)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:42.733848 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8843c5-cdd5-4bf5-aa3e-218de4c134e4 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:42.734835 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bb927-d488-4a55-97df-dacbcc3994b1 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:42.736899 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 55/109] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:12:42 2022] GET /identity/v3/users/5f1e12dbf11d4d17913d66e0e88d33c8 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:42.738904 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bb927-d488-4a55-97df-dacbcc3994b1 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:42.773107 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a16a1-c246-4914-80ac-bfbeb3107d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:42.775115 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a16a1-c246-4914-80ac-bfbeb3107d93 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:42.775115 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a16a1-c246-4914-80ac-bfbeb3107d93 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:42.775307 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a16a1-c246-4914-80ac-bfbeb3107d93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:42.791223 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a16a1-c246-4914-80ac-bfbeb3107d93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:12:42.797495 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-105a16a1-c246-4914-80ac-bfbeb3107d93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:12:42.797495 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:12:42.797495 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:12:42.797495 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:12:42.797495 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:12:42.797495 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:12:42.797495 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:12:42.797495 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:12:42.797495 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:12:42.797495 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:12:42.797495 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:12:42.797495 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:12:42.797495 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:12:42.797495 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:12:42.797495 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:12:42.797495 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:12:42.798353 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:12:42.798353 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:12:42.798353 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:12:42.798353 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:12:42.798353 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:12:42.798353 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:12:42.798353 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:12:42.798353 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:12:42.798353 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:12:42.798353 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:12:42.798353 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:12:42.798353 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:12:42.798353 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:12:42.798353 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:12:42.798353 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:12:42.798353 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:12:42.799144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:12:42.799144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:12:42.799144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:12:42.799144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:12:42.799144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:12:42.799144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:12:42.799144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:12:42.799144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:12:42.799144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:12:42.799144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:12:42.799144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:12:42.799144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:12:42.799144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 55/110] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 27 20:12:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:12:42.800395 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49bb5e-5bc1-46a6-9efa-6013dc2d5b6f None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:42.800545 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49bb5e-5bc1-46a6-9efa-6013dc2d5b6f None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:42.800830 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49bb5e-5bc1-46a6-9efa-6013dc2d5b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:42.820197 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-ad49bb5e-5bc1-46a6-9efa-6013dc2d5b6f None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:42.821462 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-ad49bb5e-5bc1-46a6-9efa-6013dc2d5b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:42.841545 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:42.861387 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bb927-d488-4a55-97df-dacbcc3994b1 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:42.891905 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 56/111] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:42.899257 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49bb5e-5bc1-46a6-9efa-6013dc2d5b6f None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:42.910083 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ac722-a8d4-4f1e-b143-fb24a9f713bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:42.910622 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ac722-a8d4-4f1e-b143-fb24a9f713bd None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:42.910906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ac722-a8d4-4f1e-b143-fb24a9f713bd None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:42.911217 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ac722-a8d4-4f1e-b143-fb24a9f713bd None admin] PATH_INFO: `/v3/users/e9603751a9ac4782a76ded03a6d72998` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:42.926666 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ac722-a8d4-4f1e-b143-fb24a9f713bd None admin] RBAC: Authorizing `identity:get_user(user_id=e9603751a9ac4782a76ded03a6d72998)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:42.928312 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ac722-a8d4-4f1e-b143-fb24a9f713bd None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:42.930249 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 56/112] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:12:42 2022] GET /identity/v3/users/e9603751a9ac4782a76ded03a6d72998 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:42.935396 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:42.936438 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebeb930-2505-4688-885d-6a8cebb2c440 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:42.936719 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebeb930-2505-4688-885d-6a8cebb2c440 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:42.936990 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebeb930-2505-4688-885d-6a8cebb2c440 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:42.938397 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 57/113] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:42.939297 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebeb930-2505-4688-885d-6a8cebb2c440 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:43.003098 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49bb5e-5bc1-46a6-9efa-6013dc2d5b6f None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:43.040361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a811ed-efbd-47e1-ab05-e0d32da7d581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:43.041011 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a811ed-efbd-47e1-ab05-e0d32da7d581 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:43.041295 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a811ed-efbd-47e1-ab05-e0d32da7d581 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:43.041573 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a811ed-efbd-47e1-ab05-e0d32da7d581 None admin] PATH_INFO: `/v3/projects/d40f8877192d4e139c6e3bd259c38e25` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:43.042735 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a811ed-efbd-47e1-ab05-e0d32da7d581 None admin] RBAC: Authorizing `identity:get_project(project_id=d40f8877192d4e139c6e3bd259c38e25)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:43.044737 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a811ed-efbd-47e1-ab05-e0d32da7d581 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:43.051545 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 57/114] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:12:42 2022] GET /identity/v3/projects/d40f8877192d4e139c6e3bd259c38e25 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:43.051545 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a811ed-efbd-47e1-ab05-e0d32da7d581 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:43.064261 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebeb930-2505-4688-885d-6a8cebb2c440 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:43.099249 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82066adc-8fb0-4d3e-ab5e-cac91d483988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:43.099794 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82066adc-8fb0-4d3e-ab5e-cac91d483988 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:43.100071 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82066adc-8fb0-4d3e-ab5e-cac91d483988 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:43.100345 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82066adc-8fb0-4d3e-ab5e-cac91d483988 None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:43.101481 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82066adc-8fb0-4d3e-ab5e-cac91d483988 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:43.101964 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82066adc-8fb0-4d3e-ab5e-cac91d483988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:43.103352 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82066adc-8fb0-4d3e-ab5e-cac91d483988 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:43.112601 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 58/115] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:12:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:43.118143 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82066adc-8fb0-4d3e-ab5e-cac91d483988 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:43.130221 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:43.157004 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a811ed-efbd-47e1-ab05-e0d32da7d581 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:43.160640 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:43.197684 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0e311-f0f3-4f5a-a304-10b95021cacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:43.198659 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0e311-f0f3-4f5a-a304-10b95021cacf None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:43.199015 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0e311-f0f3-4f5a-a304-10b95021cacf None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:43.199402 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0e311-f0f3-4f5a-a304-10b95021cacf None admin] PATH_INFO: `/v3/domains/default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:43.200654 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0e311-f0f3-4f5a-a304-10b95021cacf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:43.202193 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0e311-f0f3-4f5a-a304-10b95021cacf None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:43.203962 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 58/116] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:12:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:43.205152 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb72ace-5758-4276-a5be-df7c48f73ced None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:43.205511 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb72ace-5758-4276-a5be-df7c48f73ced None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:43.205859 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb72ace-5758-4276-a5be-df7c48f73ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:43.224020 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-5cb72ace-5758-4276-a5be-df7c48f73ced None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:43.225338 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-5cb72ace-5758-4276-a5be-df7c48f73ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:43.238708 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82066adc-8fb0-4d3e-ab5e-cac91d483988 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:43.276704 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4241a1-0028-41a2-8338-01fee737c3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:43.277423 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4241a1-0028-41a2-8338-01fee737c3b9 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:43.277716 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4241a1-0028-41a2-8338-01fee737c3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:43.278075 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4241a1-0028-41a2-8338-01fee737c3b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:43.302191 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 59/117] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:43.312346 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb72ace-5758-4276-a5be-df7c48f73ced None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:43.347464 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4241a1-0028-41a2-8338-01fee737c3b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:43.348939 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4241a1-0028-41a2-8338-01fee737c3b9 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:43.356861 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:43.411722 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb72ace-5758-4276-a5be-df7c48f73ced None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:43.413187 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:43.445091 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 59/118] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:12:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:43.445091 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4241a1-0028-41a2-8338-01fee737c3b9 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:43.451486 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cad08f-dc2f-40a4-aced-6cb5c2f07c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:43.452163 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cad08f-dc2f-40a4-aced-6cb5c2f07c8d None admin] REQUEST_METHOD: `PUT` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:43.452451 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cad08f-dc2f-40a4-aced-6cb5c2f07c8d None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:43.452730 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cad08f-dc2f-40a4-aced-6cb5c2f07c8d None admin] PATH_INFO: `/v3/projects/d40f8877192d4e139c6e3bd259c38e25/users/5f1e12dbf11d4d17913d66e0e88d33c8/roles/13a38ce5696549bf95272ffae43798c8` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:43.454680 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cad08f-dc2f-40a4-aced-6cb5c2f07c8d None admin] RBAC: Authorizing `identity:create_grant(project_id=d40f8877192d4e139c6e3bd259c38e25, user_id=5f1e12dbf11d4d17913d66e0e88d33c8, role_id=13a38ce5696549bf95272ffae43798c8)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:43.456170 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cad08f-dc2f-40a4-aced-6cb5c2f07c8d None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:43.470681 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 60/119] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 27 20:12:43 2022] PUT /identity/v3/projects/d40f8877192d4e139c6e3bd259c38e25/users/5f1e12dbf11d4d17913d66e0e88d33c8/roles/13a38ce5696549bf95272ffae43798c8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:12:43.483320 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cad08f-dc2f-40a4-aced-6cb5c2f07c8d None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:43.554788 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4241a1-0028-41a2-8338-01fee737c3b9 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:43.564839 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:43.597134 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8cdd6-8ef0-4614-a69c-b00c8342c784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:43.597947 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8cdd6-8ef0-4614-a69c-b00c8342c784 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:43.598233 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8cdd6-8ef0-4614-a69c-b00c8342c784 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:43.598513 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8cdd6-8ef0-4614-a69c-b00c8342c784 None admin] PATH_INFO: `/v3/users/5c55d2b6170e4e2782d526caffb1c6c0` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:43.599769 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8cdd6-8ef0-4614-a69c-b00c8342c784 None admin] RBAC: Authorizing `identity:get_user(user_id=5c55d2b6170e4e2782d526caffb1c6c0)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:43.601252 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8cdd6-8ef0-4614-a69c-b00c8342c784 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:43.603115 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 60/120] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:12:43 2022] GET /identity/v3/users/5c55d2b6170e4e2782d526caffb1c6c0 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:43.604228 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01cf59-218c-4867-a9af-e11ea26a16df None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:43.604510 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01cf59-218c-4867-a9af-e11ea26a16df None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:43.604782 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01cf59-218c-4867-a9af-e11ea26a16df None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:43.610873 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 61/121] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:43.610873 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01cf59-218c-4867-a9af-e11ea26a16df None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:43.611148 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cad08f-dc2f-40a4-aced-6cb5c2f07c8d None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:43.655126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202237c-cca7-4f98-809a-a42b4c4b62ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:43.655769 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202237c-cca7-4f98-809a-a42b4c4b62ee None admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:43.656053 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202237c-cca7-4f98-809a-a42b4c4b62ee None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:43.656330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202237c-cca7-4f98-809a-a42b4c4b62ee None admin] PATH_INFO: `/v3/projects` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:43.657026 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202237c-cca7-4f98-809a-a42b4c4b62ee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:43.658495 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202237c-cca7-4f98-809a-a42b4c4b62ee None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:43.695096 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 61/122] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Jul 27 20:12:43 2022] POST /identity/v3/projects => generated 302 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:12:43.695096 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202237c-cca7-4f98-809a-a42b4c4b62ee None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:43.720347 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:43.756533 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01cf59-218c-4867-a9af-e11ea26a16df None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:43.807237 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82747f33-e4a0-43f4-a830-be5c425434f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:43.808267 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82747f33-e4a0-43f4-a830-be5c425434f8 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:43.808694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82747f33-e4a0-43f4-a830-be5c425434f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:43.809800 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82747f33-e4a0-43f4-a830-be5c425434f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:43.830349 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82747f33-e4a0-43f4-a830-be5c425434f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:12:43.838247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-82747f33-e4a0-43f4-a830-be5c425434f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:12:43.838247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:12:43.838247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:12:43.838247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:12:43.838247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:12:43.838247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:12:43.838247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:12:43.838247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:12:43.838247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:12:43.838247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:12:43.838247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:12:43.838247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:12:43.838247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:12:43.838247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:12:43.838247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:12:43.838247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:12:43.839436 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:12:43.839436 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:12:43.839436 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:12:43.839436 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:12:43.839436 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:12:43.839436 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:12:43.839436 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:12:43.839436 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:12:43.839436 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:12:43.839436 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:12:43.839436 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:12:43.839436 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:12:43.839436 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:12:43.839436 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:12:43.839436 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:12:43.839436 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:12:43.841125 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:12:43.841125 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:12:43.841125 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:12:43.841125 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:12:43.841125 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:12:43.841125 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:12:43.841125 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:12:43.841125 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:12:43.841125 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:12:43.841125 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:12:43.841125 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:12:43.841125 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:12:43.841125 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 62/123] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:12:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:12:43.841939 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82747f33-e4a0-43f4-a830-be5c425434f8 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:43.846633 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202237c-cca7-4f98-809a-a42b4c4b62ee None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:43.889061 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:43.897786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04263d0e-955f-4051-a630-a78f162c2f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:43.898448 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04263d0e-955f-4051-a630-a78f162c2f03 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:43.898741 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04263d0e-955f-4051-a630-a78f162c2f03 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:43.900104 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04263d0e-955f-4051-a630-a78f162c2f03 None admin] PATH_INFO: `/v3/projects/d40f8877192d4e139c6e3bd259c38e25` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:43.902774 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04263d0e-955f-4051-a630-a78f162c2f03 None admin] RBAC: Authorizing `identity:get_project(project_id=d40f8877192d4e139c6e3bd259c38e25)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:43.903899 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04263d0e-955f-4051-a630-a78f162c2f03 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:43.905764 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 62/124] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:12:43 2022] GET /identity/v3/projects/d40f8877192d4e139c6e3bd259c38e25 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:43.907830 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d466684-8635-4bc1-a74f-73ddafc790c4 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:43.908121 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d466684-8635-4bc1-a74f-73ddafc790c4 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:43.908403 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d466684-8635-4bc1-a74f-73ddafc790c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:43.933190 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-4d466684-8635-4bc1-a74f-73ddafc790c4 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:43.934454 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-4d466684-8635-4bc1-a74f-73ddafc790c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:43.971803 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82747f33-e4a0-43f4-a830-be5c425434f8 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:44.007794 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b28c8e-3ae7-4b1c-b419-3961a71f5c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:44.008570 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b28c8e-3ae7-4b1c-b419-3961a71f5c3a None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:44.008803 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b28c8e-3ae7-4b1c-b419-3961a71f5c3a None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:44.009092 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b28c8e-3ae7-4b1c-b419-3961a71f5c3a None admin] PATH_INFO: `/v3/projects/d40f8877192d4e139c6e3bd259c38e25` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:44.010279 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b28c8e-3ae7-4b1c-b419-3961a71f5c3a None admin] RBAC: Authorizing `identity:get_project(project_id=d40f8877192d4e139c6e3bd259c38e25)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:44.011995 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b28c8e-3ae7-4b1c-b419-3961a71f5c3a None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:44.014321 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 63/125] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:12:43 2022] GET /identity/v3/projects/d40f8877192d4e139c6e3bd259c38e25 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:44.015129 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b28c8e-3ae7-4b1c-b419-3961a71f5c3a None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:44.023856 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 63/126] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:44.029564 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d466684-8635-4bc1-a74f-73ddafc790c4 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:44.054551 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:44.122121 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b28c8e-3ae7-4b1c-b419-3961a71f5c3a None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:44.123622 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:44.158708 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd0453-b7ed-420e-8fb0-55a165037c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:44.159282 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd0453-b7ed-420e-8fb0-55a165037c9a None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:44.159565 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd0453-b7ed-420e-8fb0-55a165037c9a None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:44.159839 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd0453-b7ed-420e-8fb0-55a165037c9a None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:44.160557 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd0453-b7ed-420e-8fb0-55a165037c9a None admin] RBAC: Adding query filter params (name=member) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:44.160864 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd0453-b7ed-420e-8fb0-55a165037c9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:44.162255 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd0453-b7ed-420e-8fb0-55a165037c9a None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:44.166887 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d466684-8635-4bc1-a74f-73ddafc790c4 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:44.170898 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 64/127] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:12:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:44.171550 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd0453-b7ed-420e-8fb0-55a165037c9a None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:44.205733 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ebfb0-fcca-4979-86d0-e8d12a896bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:44.206805 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ebfb0-fcca-4979-86d0-e8d12a896bc3 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:44.207429 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ebfb0-fcca-4979-86d0-e8d12a896bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:44.208004 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ebfb0-fcca-4979-86d0-e8d12a896bc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:44.208991 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ebfb0-fcca-4979-86d0-e8d12a896bc3 None admin] RBAC: Adding query filter params (role.id=b166adb7927b4a9fbd2ade12fa51de68, scope.project.id=d40f8877192d4e139c6e3bd259c38e25, user.id=e9603751a9ac4782a76ded03a6d72998) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:44.209597 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ebfb0-fcca-4979-86d0-e8d12a896bc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:44.211361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ebfb0-fcca-4979-86d0-e8d12a896bc3 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:44.218434 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 64/128] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:12:44 2022] GET /identity/v3/role_assignments?user.id=e9603751a9ac4782a76ded03a6d72998&scope.project.id=d40f8877192d4e139c6e3bd259c38e25&role.id=b166adb7927b4a9fbd2ade12fa51de68 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:44.219753 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ebfb0-fcca-4979-86d0-e8d12a896bc3 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:44.280422 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd0453-b7ed-420e-8fb0-55a165037c9a None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:44.320010 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e5baa-d72c-4773-abb6-0ca96a02d849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:44.320223 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:44.320844 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e5baa-d72c-4773-abb6-0ca96a02d849 None admin] REQUEST_METHOD: `PUT` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:44.321197 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e5baa-d72c-4773-abb6-0ca96a02d849 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:44.321551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e5baa-d72c-4773-abb6-0ca96a02d849 None admin] PATH_INFO: `/v3/projects/d40f8877192d4e139c6e3bd259c38e25/users/5c55d2b6170e4e2782d526caffb1c6c0/roles/df8ec36d044b469d8854eba8394eb107` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:44.323984 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e5baa-d72c-4773-abb6-0ca96a02d849 None admin] RBAC: Authorizing `identity:create_grant(project_id=d40f8877192d4e139c6e3bd259c38e25, user_id=5c55d2b6170e4e2782d526caffb1c6c0, role_id=df8ec36d044b469d8854eba8394eb107)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:44.326114 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e5baa-d72c-4773-abb6-0ca96a02d849 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:44.348953 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ebfb0-fcca-4979-86d0-e8d12a896bc3 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:44.359180 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 65/129] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 27 20:12:44 2022] PUT /identity/v3/projects/d40f8877192d4e139c6e3bd259c38e25/users/5c55d2b6170e4e2782d526caffb1c6c0/roles/df8ec36d044b469d8854eba8394eb107 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:12:44.360316 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e5baa-d72c-4773-abb6-0ca96a02d849 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:44.415464 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b583b8-375d-40da-9a61-504cc2286949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:44.416071 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b583b8-375d-40da-9a61-504cc2286949 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:44.416357 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b583b8-375d-40da-9a61-504cc2286949 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:44.416666 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b583b8-375d-40da-9a61-504cc2286949 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:44.435641 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:44.441120 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b583b8-375d-40da-9a61-504cc2286949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:12:44.446947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-c6b583b8-375d-40da-9a61-504cc2286949 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 20:12:44.446947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:12:44.446947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:12:44.446947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:12:44.446947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:12:44.446947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:12:44.446947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:12:44.446947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:12:44.446947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:12:44.446947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:12:44.446947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:12:44.446947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:12:44.446947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:12:44.446947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:12:44.446947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:12:44.446947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:12:44.447888 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:12:44.447888 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:12:44.447888 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:12:44.447888 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:12:44.447888 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:12:44.447888 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:12:44.447888 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:12:44.447888 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:12:44.447888 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:12:44.447888 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:12:44.447888 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:12:44.447888 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:12:44.447888 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:12:44.447888 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:12:44.447888 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:12:44.447888 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:12:44.448650 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:12:44.448650 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:12:44.448650 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:12:44.448650 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:12:44.448650 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:12:44.448650 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:12:44.448650 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:12:44.448650 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:12:44.448650 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:12:44.448650 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:12:44.448650 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 20:12:44.448650 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:12:44.456878 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 65/130] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 27 20:12:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:12:44.462742 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b583b8-375d-40da-9a61-504cc2286949 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:44.582135 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b583b8-375d-40da-9a61-504cc2286949 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:44.593487 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e5baa-d72c-4773-abb6-0ca96a02d849 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:44.618109 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68194962-38dd-45b7-91af-bbd8ec503307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:44.618748 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68194962-38dd-45b7-91af-bbd8ec503307 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:44.619037 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68194962-38dd-45b7-91af-bbd8ec503307 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:44.619360 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68194962-38dd-45b7-91af-bbd8ec503307 None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:44.620090 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68194962-38dd-45b7-91af-bbd8ec503307 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:44.620403 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68194962-38dd-45b7-91af-bbd8ec503307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:44.622383 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68194962-38dd-45b7-91af-bbd8ec503307 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:44.624995 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:44.632392 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 66/131] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:12:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:12:44.638966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68194962-38dd-45b7-91af-bbd8ec503307 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:44.678212 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700b58f-af1b-4189-8c89-4d9ab816691e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:44.678796 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700b58f-af1b-4189-8c89-4d9ab816691e None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:44.679159 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700b58f-af1b-4189-8c89-4d9ab816691e None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:44.679445 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700b58f-af1b-4189-8c89-4d9ab816691e None admin] PATH_INFO: `/v3/users/5f1e12dbf11d4d17913d66e0e88d33c8` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:44.681997 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700b58f-af1b-4189-8c89-4d9ab816691e None admin] RBAC: Authorizing `identity:get_user(user_id=5f1e12dbf11d4d17913d66e0e88d33c8)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:44.683580 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700b58f-af1b-4189-8c89-4d9ab816691e None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:44.685770 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 66/132] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:12:44 2022] GET /identity/v3/users/5f1e12dbf11d4d17913d66e0e88d33c8 => generated 275 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:44.691202 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700b58f-af1b-4189-8c89-4d9ab816691e None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:44.747975 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68194962-38dd-45b7-91af-bbd8ec503307 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:44.784222 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca3c6b-a918-4f15-8f75-da39be20383b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:44.784885 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca3c6b-a918-4f15-8f75-da39be20383b None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:44.785170 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca3c6b-a918-4f15-8f75-da39be20383b None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:44.785452 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca3c6b-a918-4f15-8f75-da39be20383b None admin] PATH_INFO: `/v3/users/5f1e12dbf11d4d17913d66e0e88d33c8` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:44.787105 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca3c6b-a918-4f15-8f75-da39be20383b None admin] RBAC: Authorizing `identity:get_user(user_id=5f1e12dbf11d4d17913d66e0e88d33c8)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:44.788575 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca3c6b-a918-4f15-8f75-da39be20383b None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:44.790197 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 67/133] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:12:44 2022] GET /identity/v3/users/5f1e12dbf11d4d17913d66e0e88d33c8 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:44.796608 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca3c6b-a918-4f15-8f75-da39be20383b None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:44.873551 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:44.881326 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:44.897781 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700b58f-af1b-4189-8c89-4d9ab816691e None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:44.916722 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca3c6b-a918-4f15-8f75-da39be20383b None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:44.956216 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39830713-a7c8-41d1-8498-fb0f7789dfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:44.957110 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39830713-a7c8-41d1-8498-fb0f7789dfb2 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:44.957673 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39830713-a7c8-41d1-8498-fb0f7789dfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:44.958094 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39830713-a7c8-41d1-8498-fb0f7789dfb2 None admin] PATH_INFO: `/v3/projects/d40f8877192d4e139c6e3bd259c38e25` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:44.959483 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39830713-a7c8-41d1-8498-fb0f7789dfb2 None admin] RBAC: Authorizing `identity:get_project(project_id=d40f8877192d4e139c6e3bd259c38e25)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:44.961125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39830713-a7c8-41d1-8498-fb0f7789dfb2 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:44.962981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 68/134] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:12:44 2022] GET /identity/v3/projects/d40f8877192d4e139c6e3bd259c38e25 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:12:44.969267 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39830713-a7c8-41d1-8498-fb0f7789dfb2 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:44.978294 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f1531-9e6d-4b1a-8522-9595f25c6ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:44.979233 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f1531-9e6d-4b1a-8522-9595f25c6ff3 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:44.979663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f1531-9e6d-4b1a-8522-9595f25c6ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:44.980089 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f1531-9e6d-4b1a-8522-9595f25c6ff3 None admin] PATH_INFO: `/v3/projects/10a079b1209640c8afb55201224df5a7` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:44.982138 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f1531-9e6d-4b1a-8522-9595f25c6ff3 None admin] RBAC: Authorizing `identity:get_project(project_id=10a079b1209640c8afb55201224df5a7)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:44.984409 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f1531-9e6d-4b1a-8522-9595f25c6ff3 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:44.986427 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 67/135] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:12:44 2022] GET /identity/v3/projects/10a079b1209640c8afb55201224df5a7 => generated 312 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:44.992649 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f1531-9e6d-4b1a-8522-9595f25c6ff3 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:45.189980 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f1531-9e6d-4b1a-8522-9595f25c6ff3 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:45.213285 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39830713-a7c8-41d1-8498-fb0f7789dfb2 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:45.263770 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e8971-9bc8-4b6a-aa3f-32b84741d688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:45.264973 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e8971-9bc8-4b6a-aa3f-32b84741d688 None admin] REQUEST_METHOD: `PUT` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:45.265549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e8971-9bc8-4b6a-aa3f-32b84741d688 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:45.266004 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e8971-9bc8-4b6a-aa3f-32b84741d688 None admin] PATH_INFO: `/v3/projects/10a079b1209640c8afb55201224df5a7/users/5f1e12dbf11d4d17913d66e0e88d33c8/roles/13a38ce5696549bf95272ffae43798c8` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:45.268562 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e8971-9bc8-4b6a-aa3f-32b84741d688 None admin] RBAC: Authorizing `identity:create_grant(project_id=10a079b1209640c8afb55201224df5a7, user_id=5f1e12dbf11d4d17913d66e0e88d33c8, role_id=13a38ce5696549bf95272ffae43798c8)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:45.270449 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e8971-9bc8-4b6a-aa3f-32b84741d688 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:45.291323 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ec1ec-764a-4010-b188-9b5196cd4c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:45.292012 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ec1ec-764a-4010-b188-9b5196cd4c74 None admin] REQUEST_METHOD: `PUT` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:45.292298 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ec1ec-764a-4010-b188-9b5196cd4c74 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:45.292584 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ec1ec-764a-4010-b188-9b5196cd4c74 None admin] PATH_INFO: `/v3/projects/d40f8877192d4e139c6e3bd259c38e25/users/5f1e12dbf11d4d17913d66e0e88d33c8/roles/b63f862c45f24bd8856021d73b8fa0e2` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:45.295453 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ec1ec-764a-4010-b188-9b5196cd4c74 None admin] RBAC: Authorizing `identity:create_grant(project_id=d40f8877192d4e139c6e3bd259c38e25, user_id=5f1e12dbf11d4d17913d66e0e88d33c8, role_id=b63f862c45f24bd8856021d73b8fa0e2)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:45.297060 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ec1ec-764a-4010-b188-9b5196cd4c74 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:45.300190 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:45.302594 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 68/136] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 27 20:12:44 2022] PUT /identity/v3/projects/10a079b1209640c8afb55201224df5a7/users/5f1e12dbf11d4d17913d66e0e88d33c8/roles/13a38ce5696549bf95272ffae43798c8 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:12:45.332655 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 69/137] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 27 20:12:44 2022] PUT /identity/v3/projects/d40f8877192d4e139c6e3bd259c38e25/users/5f1e12dbf11d4d17913d66e0e88d33c8/roles/b63f862c45f24bd8856021d73b8fa0e2 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 20:12:46.772806 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17738ff3-a60c-4c40-80f2-0d3bf45409d0 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:46.773819 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17738ff3-a60c-4c40-80f2-0d3bf45409d0 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:46.774335 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17738ff3-a60c-4c40-80f2-0d3bf45409d0 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:46.775928 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 69/138] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:46.788531 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f5d48-a003-40d2-826a-8c08b5e0042d None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:46.788967 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f5d48-a003-40d2-826a-8c08b5e0042d None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:46.789162 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f5d48-a003-40d2-826a-8c08b5e0042d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:46.824352 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-5b2f5d48-a003-40d2-826a-8c08b5e0042d None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:46.825558 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-5b2f5d48-a003-40d2-826a-8c08b5e0042d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:46.908925 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 70/139] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 20:12:46.917923 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b472ed-9ddb-40a6-8b6d-3a5126fc77a7 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:46.918993 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b472ed-9ddb-40a6-8b6d-3a5126fc77a7 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:46.919540 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b472ed-9ddb-40a6-8b6d-3a5126fc77a7 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:46.922307 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 70/140] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:46.926826 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dd8cd-0c57-4d4c-bd81-1127f16e9f1d None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:46.927137 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dd8cd-0c57-4d4c-bd81-1127f16e9f1d None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:46.927417 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dd8cd-0c57-4d4c-bd81-1127f16e9f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:46.949962 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b472ed-9ddb-40a6-8b6d-3a5126fc77a7 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:46.951031 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-992dd8cd-0c57-4d4c-bd81-1127f16e9f1d None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:46.952237 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-992dd8cd-0c57-4d4c-bd81-1127f16e9f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:46.995440 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:47.068920 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 71/141] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:47.116875 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dd8cd-0c57-4d4c-bd81-1127f16e9f1d None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:47.144595 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b472ed-9ddb-40a6-8b6d-3a5126fc77a7 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:47.218985 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00968c-03f5-4a9f-a1eb-396dcfc53b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:47.219671 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00968c-03f5-4a9f-a1eb-396dcfc53b24 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:47.220018 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00968c-03f5-4a9f-a1eb-396dcfc53b24 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:47.220391 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00968c-03f5-4a9f-a1eb-396dcfc53b24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:47.221516 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00968c-03f5-4a9f-a1eb-396dcfc53b24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:47.223049 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00968c-03f5-4a9f-a1eb-396dcfc53b24 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:47.228095 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:47.231795 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 71/142] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:12:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:47.249485 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00968c-03f5-4a9f-a1eb-396dcfc53b24 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:47.329838 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dd8cd-0c57-4d4c-bd81-1127f16e9f1d None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:47.384910 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:47.395801 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabc7bd-0d7e-4c9c-9287-0dbede14af87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:47.396471 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabc7bd-0d7e-4c9c-9287-0dbede14af87 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:47.396757 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabc7bd-0d7e-4c9c-9287-0dbede14af87 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:47.397038 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabc7bd-0d7e-4c9c-9287-0dbede14af87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:47.399228 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00968c-03f5-4a9f-a1eb-396dcfc53b24 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:47.416560 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabc7bd-0d7e-4c9c-9287-0dbede14af87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:12:47.422125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-7fabc7bd-0d7e-4c9c-9287-0dbede14af87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:12:47.422125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:12:47.422125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:12:47.422125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:12:47.422125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:12:47.422125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:12:47.422125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:12:47.422125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:12:47.422125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:12:47.422125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:12:47.422125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:12:47.422125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:12:47.422125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:12:47.422125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:12:47.422125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:12:47.422125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:12:47.422962 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:12:47.422962 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:12:47.422962 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:12:47.422962 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:12:47.422962 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:12:47.422962 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:12:47.422962 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:12:47.422962 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:12:47.422962 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:12:47.422962 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:12:47.422962 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:12:47.422962 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:12:47.422962 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:12:47.422962 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:12:47.422962 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:12:47.422962 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:12:47.423737 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:12:47.423737 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:12:47.423737 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:12:47.423737 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:12:47.423737 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:12:47.423737 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:12:47.423737 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:12:47.423737 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:12:47.423737 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:12:47.423737 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:12:47.423737 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:12:47.423737 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:12:47.427429 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 72/143] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:12:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:12:47.428903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acde981-32f8-4e6d-a979-39495de37153 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:47.429382 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acde981-32f8-4e6d-a979-39495de37153 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:47.429845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acde981-32f8-4e6d-a979-39495de37153 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:47.431336 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 73/144] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:47.434717 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acde981-32f8-4e6d-a979-39495de37153 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:47.440659 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397cd5b-d11a-4502-90ef-07e595968f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:47.441301 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397cd5b-d11a-4502-90ef-07e595968f0f None admin] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:47.441587 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397cd5b-d11a-4502-90ef-07e595968f0f None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:47.441864 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397cd5b-d11a-4502-90ef-07e595968f0f None admin] PATH_INFO: `/v3/users` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:47.442552 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397cd5b-d11a-4502-90ef-07e595968f0f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:47.444031 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397cd5b-d11a-4502-90ef-07e595968f0f None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:47.481466 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 72/145] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 27 20:12:47 2022] POST /identity/v3/users => generated 283 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 20:12:47.483004 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035d8c4-e0c2-4027-bf89-f99b1fb5e679 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:47.487532 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035d8c4-e0c2-4027-bf89-f99b1fb5e679 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:47.487837 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035d8c4-e0c2-4027-bf89-f99b1fb5e679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:47.520103 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-9035d8c4-e0c2-4027-bf89-f99b1fb5e679 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:47.521324 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-9035d8c4-e0c2-4027-bf89-f99b1fb5e679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:47.609061 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acde981-32f8-4e6d-a979-39495de37153 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:47.630034 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:47.665647 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba7794-4ae1-4b6c-a9e4-9200ee4c03a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:47.666609 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba7794-4ae1-4b6c-a9e4-9200ee4c03a2 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:47.667137 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba7794-4ae1-4b6c-a9e4-9200ee4c03a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:47.667614 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba7794-4ae1-4b6c-a9e4-9200ee4c03a2 None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:47.668626 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba7794-4ae1-4b6c-a9e4-9200ee4c03a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:47.669393 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba7794-4ae1-4b6c-a9e4-9200ee4c03a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:47.671058 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba7794-4ae1-4b6c-a9e4-9200ee4c03a2 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:47.685114 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 74/146] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:12:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:47.692366 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8145e-af85-4577-8184-eecbe86e6999 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:47.693206 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8145e-af85-4577-8184-eecbe86e6999 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:47.693758 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8145e-af85-4577-8184-eecbe86e6999 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:47.697730 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 75/147] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:47.700944 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8145e-af85-4577-8184-eecbe86e6999 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:47.750653 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 73/148] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:47.751986 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cc667-5b35-41f6-82bb-f779c9d7363e None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:47.752278 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cc667-5b35-41f6-82bb-f779c9d7363e None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:47.752558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cc667-5b35-41f6-82bb-f779c9d7363e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:47.779684 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-b66cc667-5b35-41f6-82bb-f779c9d7363e None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:47.781111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-b66cc667-5b35-41f6-82bb-f779c9d7363e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:47.842320 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8145e-af85-4577-8184-eecbe86e6999 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:47.895507 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 74/149] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:47.896440 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cc667-5b35-41f6-82bb-f779c9d7363e None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:47.906850 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0deb7af-ff62-495f-8df7-c4f27406fe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:47.907582 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0deb7af-ff62-495f-8df7-c4f27406fe81 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:47.908346 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0deb7af-ff62-495f-8df7-c4f27406fe81 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:47.908629 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0deb7af-ff62-495f-8df7-c4f27406fe81 None admin] PATH_INFO: `/v3/users/5f1e12dbf11d4d17913d66e0e88d33c8` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:47.910695 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:47.913292 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0deb7af-ff62-495f-8df7-c4f27406fe81 None admin] RBAC: Authorizing `identity:get_user(user_id=5f1e12dbf11d4d17913d66e0e88d33c8)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:47.916034 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0deb7af-ff62-495f-8df7-c4f27406fe81 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:47.919150 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 76/150] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:12:47 2022] GET /identity/v3/users/5f1e12dbf11d4d17913d66e0e88d33c8 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:47.922791 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0deb7af-ff62-495f-8df7-c4f27406fe81 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:48.004612 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:48.042966 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cc667-5b35-41f6-82bb-f779c9d7363e None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:48.079047 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0deb7af-ff62-495f-8df7-c4f27406fe81 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:48.085255 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ccbca-5e64-497b-9aa3-d50faba2de5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:48.086008 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ccbca-5e64-497b-9aa3-d50faba2de5d None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:48.086404 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ccbca-5e64-497b-9aa3-d50faba2de5d None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:48.086755 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ccbca-5e64-497b-9aa3-d50faba2de5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:48.101130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ccbca-5e64-497b-9aa3-d50faba2de5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:12:48.106170 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-1a9ccbca-5e64-497b-9aa3-d50faba2de5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:12:48.106170 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:12:48.106170 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:12:48.106170 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:12:48.106170 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:12:48.106170 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:12:48.106170 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:12:48.106170 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:12:48.106170 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:12:48.106170 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:12:48.106170 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:12:48.106170 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:12:48.106170 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:12:48.106170 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:12:48.106170 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:12:48.106170 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:12:48.107017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:12:48.107017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:12:48.107017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:12:48.107017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:12:48.107017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:12:48.107017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:12:48.107017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:12:48.107017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:12:48.107017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:12:48.107017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:12:48.107017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:12:48.107017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:12:48.107017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:12:48.107017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:12:48.107017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:12:48.107017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:12:48.107877 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:12:48.107877 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:12:48.107877 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:12:48.107877 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:12:48.107877 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:12:48.107877 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:12:48.107877 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:12:48.107877 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:12:48.107877 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:12:48.107877 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:12:48.107877 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:12:48.107877 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:12:48.107877 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 75/151] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 27 20:12:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:12:48.108509 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ccbca-5e64-497b-9aa3-d50faba2de5d None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:48.126014 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad51fc-9552-4b15-befe-5ab38d56b5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:48.127082 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad51fc-9552-4b15-befe-5ab38d56b5d0 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:48.127669 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad51fc-9552-4b15-befe-5ab38d56b5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:48.128005 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad51fc-9552-4b15-befe-5ab38d56b5d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:48.193198 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:48.224671 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad51fc-9552-4b15-befe-5ab38d56b5d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:48.226767 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad51fc-9552-4b15-befe-5ab38d56b5d0 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:48.242177 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ccbca-5e64-497b-9aa3-d50faba2de5d None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:48.284560 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:48.285961 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ecc62-a915-4751-8dd0-74af8c18d882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:48.286873 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ecc62-a915-4751-8dd0-74af8c18d882 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:48.287100 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ecc62-a915-4751-8dd0-74af8c18d882 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:48.287408 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ecc62-a915-4751-8dd0-74af8c18d882 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:48.300443 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ecc62-a915-4751-8dd0-74af8c18d882 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:12:48.310036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-801ecc62-a915-4751-8dd0-74af8c18d882 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 20:12:48.310036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:12:48.310036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:12:48.310036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:12:48.310036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:12:48.310036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:12:48.310036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:12:48.310036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:12:48.310036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:12:48.310036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:12:48.310036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:12:48.310036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:12:48.310036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:12:48.310036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:12:48.310036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:12:48.310036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:12:48.310949 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:12:48.310949 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:12:48.310949 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:12:48.310949 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:12:48.310949 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:12:48.310949 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:12:48.310949 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:12:48.310949 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:12:48.310949 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:12:48.310949 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:12:48.310949 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:12:48.310949 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:12:48.310949 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:12:48.310949 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:12:48.310949 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:12:48.310949 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:12:48.311744 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:12:48.311744 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:12:48.311744 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:12:48.311744 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:12:48.311744 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:12:48.311744 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:12:48.311744 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:12:48.311744 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:12:48.311744 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:12:48.311744 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:12:48.311744 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 20:12:48.311744 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:12:48.311744 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 76/152] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:12:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:12:48.311744 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ecc62-a915-4751-8dd0-74af8c18d882 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:48.373184 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 77/153] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:12:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 20:12:48.374205 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad51fc-9552-4b15-befe-5ab38d56b5d0 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:48.489886 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad51fc-9552-4b15-befe-5ab38d56b5d0 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:48.533463 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3b82f-d308-42e9-83ae-34387906e27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:48.534102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3b82f-d308-42e9-83ae-34387906e27b None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:48.534382 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3b82f-d308-42e9-83ae-34387906e27b None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:48.534655 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3b82f-d308-42e9-83ae-34387906e27b None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:48.535409 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3b82f-d308-42e9-83ae-34387906e27b None admin] RBAC: Adding query filter params (name=reader) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:48.535717 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3b82f-d308-42e9-83ae-34387906e27b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:48.537122 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3b82f-d308-42e9-83ae-34387906e27b None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:48.560576 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 78/154] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:12:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:48.561457 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3b82f-d308-42e9-83ae-34387906e27b None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:48.577681 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:48.580314 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ecc62-a915-4751-8dd0-74af8c18d882 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:48.629887 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:48.646423 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbff5d9-9a8b-4288-b425-68bc420462d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:48.647227 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbff5d9-9a8b-4288-b425-68bc420462d9 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:48.647609 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbff5d9-9a8b-4288-b425-68bc420462d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:48.647888 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbff5d9-9a8b-4288-b425-68bc420462d9 None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:48.648614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbff5d9-9a8b-4288-b425-68bc420462d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:48.648918 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbff5d9-9a8b-4288-b425-68bc420462d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:48.653038 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbff5d9-9a8b-4288-b425-68bc420462d9 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:48.665022 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 77/155] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:12:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:48.665677 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbff5d9-9a8b-4288-b425-68bc420462d9 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:48.706884 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3b82f-d308-42e9-83ae-34387906e27b None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:48.748207 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667ff57-7eb3-430a-aedc-ecefc7f5d490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:48.748897 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667ff57-7eb3-430a-aedc-ecefc7f5d490 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:48.749187 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667ff57-7eb3-430a-aedc-ecefc7f5d490 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:48.749459 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667ff57-7eb3-430a-aedc-ecefc7f5d490 None admin] PATH_INFO: `/v3/projects/d40f8877192d4e139c6e3bd259c38e25` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:48.750626 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667ff57-7eb3-430a-aedc-ecefc7f5d490 None admin] RBAC: Authorizing `identity:get_project(project_id=d40f8877192d4e139c6e3bd259c38e25)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:48.752198 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667ff57-7eb3-430a-aedc-ecefc7f5d490 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:48.754411 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 79/156] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:12:48 2022] GET /identity/v3/projects/d40f8877192d4e139c6e3bd259c38e25 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:48.755856 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced021c-a232-4a09-895a-dd9c1348ef08 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:48.756055 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced021c-a232-4a09-895a-dd9c1348ef08 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:48.756319 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced021c-a232-4a09-895a-dd9c1348ef08 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:48.757670 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 80/157] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:48.758401 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced021c-a232-4a09-895a-dd9c1348ef08 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:48.803336 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbff5d9-9a8b-4288-b425-68bc420462d9 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:48.856413 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:48.869706 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb5697-7765-4a17-9c36-6189cc580ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:48.870361 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb5697-7765-4a17-9c36-6189cc580ea0 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:48.870736 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb5697-7765-4a17-9c36-6189cc580ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:48.871171 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb5697-7765-4a17-9c36-6189cc580ea0 None admin] PATH_INFO: `/v3/users/e9603751a9ac4782a76ded03a6d72998` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:48.872361 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb5697-7765-4a17-9c36-6189cc580ea0 None admin] RBAC: Authorizing `identity:get_user(user_id=e9603751a9ac4782a76ded03a6d72998)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:48.873927 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb5697-7765-4a17-9c36-6189cc580ea0 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:48.879870 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 78/158] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:12:48 2022] GET /identity/v3/users/e9603751a9ac4782a76ded03a6d72998 => generated 289 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:48.881267 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676edeb-af1d-48d6-82f1-6ca0b5ad7c93 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:48.881553 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676edeb-af1d-48d6-82f1-6ca0b5ad7c93 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:48.881830 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676edeb-af1d-48d6-82f1-6ca0b5ad7c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:48.885087 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced021c-a232-4a09-895a-dd9c1348ef08 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:48.912667 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-0676edeb-af1d-48d6-82f1-6ca0b5ad7c93 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:48.913968 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-0676edeb-af1d-48d6-82f1-6ca0b5ad7c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:48.931769 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0af992-0638-4324-8963-93b1fdebdf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:48.932399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0af992-0638-4324-8963-93b1fdebdf30 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:48.932672 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0af992-0638-4324-8963-93b1fdebdf30 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:48.932948 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0af992-0638-4324-8963-93b1fdebdf30 None admin] PATH_INFO: `/v3/users/5c55d2b6170e4e2782d526caffb1c6c0` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:48.934205 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0af992-0638-4324-8963-93b1fdebdf30 None admin] RBAC: Authorizing `identity:get_user(user_id=5c55d2b6170e4e2782d526caffb1c6c0)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:48.937783 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0af992-0638-4324-8963-93b1fdebdf30 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:48.937783 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 81/159] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:12:48 2022] GET /identity/v3/users/5c55d2b6170e4e2782d526caffb1c6c0 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:48.938470 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0af992-0638-4324-8963-93b1fdebdf30 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:49.024630 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:49.051886 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0af992-0638-4324-8963-93b1fdebdf30 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:49.066663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 79/160] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:49.067602 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676edeb-af1d-48d6-82f1-6ca0b5ad7c93 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:49.088725 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b2a96-a8b1-45bc-96af-a485403e7f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:49.089352 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b2a96-a8b1-45bc-96af-a485403e7f32 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:49.089633 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b2a96-a8b1-45bc-96af-a485403e7f32 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:49.090536 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b2a96-a8b1-45bc-96af-a485403e7f32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:49.091401 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b2a96-a8b1-45bc-96af-a485403e7f32 None admin] RBAC: Adding query filter params (role.id=13a38ce5696549bf95272ffae43798c8, scope.project.id=d40f8877192d4e139c6e3bd259c38e25, user.id=5f1e12dbf11d4d17913d66e0e88d33c8) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:49.091708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b2a96-a8b1-45bc-96af-a485403e7f32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:49.093262 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b2a96-a8b1-45bc-96af-a485403e7f32 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:49.100216 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 82/161] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:12:48 2022] GET /identity/v3/role_assignments?user.id=5f1e12dbf11d4d17913d66e0e88d33c8&scope.project.id=d40f8877192d4e139c6e3bd259c38e25&role.id=13a38ce5696549bf95272ffae43798c8 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:49.101051 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b2a96-a8b1-45bc-96af-a485403e7f32 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:49.110922 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:49.213987 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b2a96-a8b1-45bc-96af-a485403e7f32 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:49.253144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec32ab-b40b-435b-973b-d7814b9868ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:49.254160 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec32ab-b40b-435b-973b-d7814b9868ff None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:49.254464 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec32ab-b40b-435b-973b-d7814b9868ff None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:49.254718 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec32ab-b40b-435b-973b-d7814b9868ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:49.322643 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676edeb-af1d-48d6-82f1-6ca0b5ad7c93 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:49.332783 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec32ab-b40b-435b-973b-d7814b9868ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:49.334312 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec32ab-b40b-435b-973b-d7814b9868ff None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:49.356949 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:49.428841 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb432ea-fca8-4154-8ad8-f8f57650e120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:49.429475 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb432ea-fca8-4154-8ad8-f8f57650e120 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:49.429757 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb432ea-fca8-4154-8ad8-f8f57650e120 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:49.430033 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb432ea-fca8-4154-8ad8-f8f57650e120 None admin] PATH_INFO: `/v3/projects/d40f8877192d4e139c6e3bd259c38e25` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:49.431350 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb432ea-fca8-4154-8ad8-f8f57650e120 None admin] RBAC: Authorizing `identity:get_project(project_id=d40f8877192d4e139c6e3bd259c38e25)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:49.432798 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb432ea-fca8-4154-8ad8-f8f57650e120 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:49.435003 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 80/162] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:12:49 2022] GET /identity/v3/projects/d40f8877192d4e139c6e3bd259c38e25 => generated 298 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:49.444636 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921fa55-65c4-4024-8c74-9d0d3f489218 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:49.444929 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921fa55-65c4-4024-8c74-9d0d3f489218 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:49.445209 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921fa55-65c4-4024-8c74-9d0d3f489218 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:49.446703 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 81/163] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:49 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:49.447271 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921fa55-65c4-4024-8c74-9d0d3f489218 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:49.452280 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 83/164] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:12:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:49.453153 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec32ab-b40b-435b-973b-d7814b9868ff None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:49.529117 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:49.584954 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921fa55-65c4-4024-8c74-9d0d3f489218 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:49.623088 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f14f9-fb9e-4624-a7ab-9c9f9d490ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:49.623881 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f14f9-fb9e-4624-a7ab-9c9f9d490ccf None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:49.624163 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f14f9-fb9e-4624-a7ab-9c9f9d490ccf None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:49.624437 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f14f9-fb9e-4624-a7ab-9c9f9d490ccf None admin] PATH_INFO: `/v3/roles/member` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:49.637455 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f14f9-fb9e-4624-a7ab-9c9f9d490ccf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:12:49.643446 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-550f14f9-fb9e-4624-a7ab-9c9f9d490ccf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:12:49.643446 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:12:49.643446 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:12:49.643446 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:12:49.643446 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:12:49.643446 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:12:49.643446 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:12:49.643446 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:12:49.643446 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:12:49.643446 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:12:49.643446 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:12:49.643446 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:12:49.643446 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:12:49.643446 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:12:49.643446 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:12:49.643446 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:12:49.644350 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:12:49.644350 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:12:49.644350 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:12:49.644350 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:12:49.644350 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:12:49.644350 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:12:49.644350 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:12:49.644350 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:12:49.644350 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:12:49.644350 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:12:49.644350 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:12:49.644350 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:12:49.644350 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:12:49.644350 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:12:49.644350 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:12:49.644350 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:12:49.645115 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:12:49.645115 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:12:49.645115 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:12:49.645115 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:12:49.645115 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:12:49.645115 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:12:49.645115 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:12:49.645115 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:12:49.645115 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:12:49.645115 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:12:49.645115 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:12:49.645115 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:12:49.645957 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 82/165] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:12:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:12:49.647191 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082486df-5646-4afc-8ac8-bfb09d44afdf None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:49.648371 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082486df-5646-4afc-8ac8-bfb09d44afdf None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:49.648371 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082486df-5646-4afc-8ac8-bfb09d44afdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:49.668234 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-082486df-5646-4afc-8ac8-bfb09d44afdf None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:49.669474 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-082486df-5646-4afc-8ac8-bfb09d44afdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:49.741233 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec32ab-b40b-435b-973b-d7814b9868ff None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:49.747403 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 83/166] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:49.748265 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082486df-5646-4afc-8ac8-bfb09d44afdf None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:49.754341 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:49.797877 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:49.847923 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1585762-e86b-496e-b6f0-3fb4291998be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:49.848977 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1585762-e86b-496e-b6f0-3fb4291998be None admin] REQUEST_METHOD: `PUT` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:49.849461 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1585762-e86b-496e-b6f0-3fb4291998be None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:49.849936 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1585762-e86b-496e-b6f0-3fb4291998be None admin] PATH_INFO: `/v3/projects/d40f8877192d4e139c6e3bd259c38e25/users/e9603751a9ac4782a76ded03a6d72998/roles/b166adb7927b4a9fbd2ade12fa51de68` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:49.852331 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1585762-e86b-496e-b6f0-3fb4291998be None admin] RBAC: Authorizing `identity:create_grant(project_id=d40f8877192d4e139c6e3bd259c38e25, user_id=e9603751a9ac4782a76ded03a6d72998, role_id=b166adb7927b4a9fbd2ade12fa51de68)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:49.854004 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1585762-e86b-496e-b6f0-3fb4291998be None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:49.868027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082486df-5646-4afc-8ac8-bfb09d44afdf None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:49.891302 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 84/167] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 27 20:12:49 2022] PUT /identity/v3/projects/d40f8877192d4e139c6e3bd259c38e25/users/e9603751a9ac4782a76ded03a6d72998/roles/b166adb7927b4a9fbd2ade12fa51de68 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:12:49.895734 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1585762-e86b-496e-b6f0-3fb4291998be None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:49.910314 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd8502-05aa-4872-b9aa-2c41880014a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:49.911025 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd8502-05aa-4872-b9aa-2c41880014a9 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:49.911322 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd8502-05aa-4872-b9aa-2c41880014a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:49.911600 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd8502-05aa-4872-b9aa-2c41880014a9 None admin] PATH_INFO: `/v3/projects/d40f8877192d4e139c6e3bd259c38e25` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:49.915095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd8502-05aa-4872-b9aa-2c41880014a9 None admin] RBAC: Authorizing `identity:get_project(project_id=d40f8877192d4e139c6e3bd259c38e25)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:49.915095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd8502-05aa-4872-b9aa-2c41880014a9 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:49.916193 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 84/168] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:12:49 2022] GET /identity/v3/projects/d40f8877192d4e139c6e3bd259c38e25 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:49.916973 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd8502-05aa-4872-b9aa-2c41880014a9 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:50.028799 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd8502-05aa-4872-b9aa-2c41880014a9 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:50.039905 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:50.066230 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687938a-7e34-4256-b79c-e2e06fd76081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:50.067168 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687938a-7e34-4256-b79c-e2e06fd76081 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:50.067642 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687938a-7e34-4256-b79c-e2e06fd76081 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:50.068062 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687938a-7e34-4256-b79c-e2e06fd76081 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:50.080638 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687938a-7e34-4256-b79c-e2e06fd76081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:12:50.086164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-8687938a-7e34-4256-b79c-e2e06fd76081 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 20:12:50.086164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:12:50.086164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:12:50.086164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:12:50.086164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:12:50.086164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:12:50.086164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:12:50.086164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:12:50.086164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:12:50.086164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:12:50.086164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:12:50.086164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:12:50.086164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:12:50.086164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:12:50.086164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:12:50.086164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:12:50.087164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:12:50.087164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:12:50.087164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:12:50.087164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:12:50.087164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:12:50.087164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:12:50.087164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:12:50.087164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:12:50.087164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:12:50.087164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:12:50.087164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:12:50.087164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:12:50.087164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:12:50.087164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:12:50.087164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:12:50.087164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:12:50.087946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:12:50.087946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:12:50.087946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:12:50.087946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:12:50.087946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:12:50.087946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:12:50.087946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:12:50.087946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:12:50.087946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:12:50.087946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:12:50.087946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 20:12:50.087946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:12:50.090395 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 85/169] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 27 20:12:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:12:50.091458 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687938a-7e34-4256-b79c-e2e06fd76081 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:50.127235 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1585762-e86b-496e-b6f0-3fb4291998be None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:50.193221 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a617eb4-00e8-404e-bd8c-e374b70e0f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:50.193876 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a617eb4-00e8-404e-bd8c-e374b70e0f74 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:50.194164 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a617eb4-00e8-404e-bd8c-e374b70e0f74 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:50.194442 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a617eb4-00e8-404e-bd8c-e374b70e0f74 None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:50.195245 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a617eb4-00e8-404e-bd8c-e374b70e0f74 None admin] RBAC: Adding query filter params (name=member) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:50.195504 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a617eb4-00e8-404e-bd8c-e374b70e0f74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:50.196898 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a617eb4-00e8-404e-bd8c-e374b70e0f74 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:50.203579 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687938a-7e34-4256-b79c-e2e06fd76081 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:50.215432 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 85/170] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:12:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:50.216440 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a617eb4-00e8-404e-bd8c-e374b70e0f74 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:50.242222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b6636-5aa9-4586-a1ac-18087da39b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:50.243327 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b6636-5aa9-4586-a1ac-18087da39b32 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:50.243810 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b6636-5aa9-4586-a1ac-18087da39b32 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:50.244283 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b6636-5aa9-4586-a1ac-18087da39b32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:50.245287 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b6636-5aa9-4586-a1ac-18087da39b32 None admin] RBAC: Adding query filter params (role.id=df8ec36d044b469d8854eba8394eb107, scope.project.id=d40f8877192d4e139c6e3bd259c38e25, user.id=5c55d2b6170e4e2782d526caffb1c6c0) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:50.245838 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b6636-5aa9-4586-a1ac-18087da39b32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:50.248141 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b6636-5aa9-4586-a1ac-18087da39b32 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:50.255518 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 86/171] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:12:50 2022] GET /identity/v3/role_assignments?user.id=5c55d2b6170e4e2782d526caffb1c6c0&scope.project.id=d40f8877192d4e139c6e3bd259c38e25&role.id=df8ec36d044b469d8854eba8394eb107 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:50.256675 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b6636-5aa9-4586-a1ac-18087da39b32 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:50.298249 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:50.308232 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:50.378264 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b6636-5aa9-4586-a1ac-18087da39b32 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:50.419038 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ea0c9-1d23-463f-bbf9-87908cac45f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:50.420598 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ea0c9-1d23-463f-bbf9-87908cac45f1 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:50.421086 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ea0c9-1d23-463f-bbf9-87908cac45f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:50.421714 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ea0c9-1d23-463f-bbf9-87908cac45f1 None admin] PATH_INFO: `/v3/users/5f1e12dbf11d4d17913d66e0e88d33c8` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:50.423153 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ea0c9-1d23-463f-bbf9-87908cac45f1 None admin] RBAC: Authorizing `identity:get_user(user_id=5f1e12dbf11d4d17913d66e0e88d33c8)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:50.425015 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ea0c9-1d23-463f-bbf9-87908cac45f1 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:50.427366 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 87/172] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:12:50 2022] GET /identity/v3/users/5f1e12dbf11d4d17913d66e0e88d33c8 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:50.436109 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ea0c9-1d23-463f-bbf9-87908cac45f1 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:50.458134 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a617eb4-00e8-404e-bd8c-e374b70e0f74 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:50.516953 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3b342-782a-4feb-bbab-7155bacadc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:50.517595 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3b342-782a-4feb-bbab-7155bacadc5d None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:50.517931 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3b342-782a-4feb-bbab-7155bacadc5d None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:50.518212 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3b342-782a-4feb-bbab-7155bacadc5d None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:50.518938 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3b342-782a-4feb-bbab-7155bacadc5d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:50.519289 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3b342-782a-4feb-bbab-7155bacadc5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:50.520669 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3b342-782a-4feb-bbab-7155bacadc5d None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:50.530534 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 86/173] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:12:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:50.536385 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3b342-782a-4feb-bbab-7155bacadc5d None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:50.602089 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ea0c9-1d23-463f-bbf9-87908cac45f1 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:50.604381 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:50.652552 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffefd9-4cd7-4c6b-8c33-7c84437c5863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:50.659893 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffefd9-4cd7-4c6b-8c33-7c84437c5863 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:50.660276 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffefd9-4cd7-4c6b-8c33-7c84437c5863 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:50.660647 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffefd9-4cd7-4c6b-8c33-7c84437c5863 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:50.680799 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:50.697759 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3b342-782a-4feb-bbab-7155bacadc5d None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:50.751133 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffefd9-4cd7-4c6b-8c33-7c84437c5863 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:50.752777 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffefd9-4cd7-4c6b-8c33-7c84437c5863 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:50.763966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb0ffb-baff-4b9e-9fd8-7bf3059f9128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:50.764960 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb0ffb-baff-4b9e-9fd8-7bf3059f9128 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:50.765391 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb0ffb-baff-4b9e-9fd8-7bf3059f9128 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:50.765813 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb0ffb-baff-4b9e-9fd8-7bf3059f9128 None admin] PATH_INFO: `/v3/users/5f1e12dbf11d4d17913d66e0e88d33c8` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:50.769708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb0ffb-baff-4b9e-9fd8-7bf3059f9128 None admin] RBAC: Authorizing `identity:get_user(user_id=5f1e12dbf11d4d17913d66e0e88d33c8)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:50.771443 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb0ffb-baff-4b9e-9fd8-7bf3059f9128 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:50.773427 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 87/174] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:12:50 2022] GET /identity/v3/users/5f1e12dbf11d4d17913d66e0e88d33c8 => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:50.778879 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb0ffb-baff-4b9e-9fd8-7bf3059f9128 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:50.858040 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 88/175] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:12:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:50.863545 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffefd9-4cd7-4c6b-8c33-7c84437c5863 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:50.865595 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:50.953928 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb0ffb-baff-4b9e-9fd8-7bf3059f9128 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:50.969236 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffefd9-4cd7-4c6b-8c33-7c84437c5863 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:50.997864 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a64d54-b43b-4148-a2ed-33a2f4469cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:50.998834 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a64d54-b43b-4148-a2ed-33a2f4469cde None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:50.999319 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a64d54-b43b-4148-a2ed-33a2f4469cde None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:50.999780 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a64d54-b43b-4148-a2ed-33a2f4469cde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:51.006711 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45d9db-82e1-4ee5-ac16-0d2c444244c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:51.008150 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45d9db-82e1-4ee5-ac16-0d2c444244c7 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:51.008498 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45d9db-82e1-4ee5-ac16-0d2c444244c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:51.008836 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45d9db-82e1-4ee5-ac16-0d2c444244c7 None admin] PATH_INFO: `/v3/projects/10a079b1209640c8afb55201224df5a7` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:51.010111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45d9db-82e1-4ee5-ac16-0d2c444244c7 None admin] RBAC: Authorizing `identity:get_project(project_id=10a079b1209640c8afb55201224df5a7)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:51.012234 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45d9db-82e1-4ee5-ac16-0d2c444244c7 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:51.013994 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 89/176] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:12:50 2022] GET /identity/v3/projects/10a079b1209640c8afb55201224df5a7 => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:51.020935 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45d9db-82e1-4ee5-ac16-0d2c444244c7 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:51.033981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:51.081326 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a64d54-b43b-4148-a2ed-33a2f4469cde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:51.083150 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a64d54-b43b-4148-a2ed-33a2f4469cde None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:51.092111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:51.130400 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45d9db-82e1-4ee5-ac16-0d2c444244c7 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:51.185709 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918bc24e-b3c1-49ce-9d9a-c2ff8804c659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:51.186438 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bc24e-b3c1-49ce-9d9a-c2ff8804c659 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:51.186786 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bc24e-b3c1-49ce-9d9a-c2ff8804c659 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:51.187165 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bc24e-b3c1-49ce-9d9a-c2ff8804c659 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:51.188028 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918bc24e-b3c1-49ce-9d9a-c2ff8804c659 None admin] RBAC: Adding query filter params (role.id=13a38ce5696549bf95272ffae43798c8, scope.project.id=10a079b1209640c8afb55201224df5a7, user.id=5f1e12dbf11d4d17913d66e0e88d33c8) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:51.188531 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918bc24e-b3c1-49ce-9d9a-c2ff8804c659 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:51.189944 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918bc24e-b3c1-49ce-9d9a-c2ff8804c659 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:51.196864 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 88/177] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:12:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:51.200663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 90/178] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:12:51 2022] GET /identity/v3/role_assignments?user.id=5f1e12dbf11d4d17913d66e0e88d33c8&scope.project.id=10a079b1209640c8afb55201224df5a7&role.id=13a38ce5696549bf95272ffae43798c8 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:12:51.208288 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a64d54-b43b-4148-a2ed-33a2f4469cde None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:51.281281 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:51.332461 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a64d54-b43b-4148-a2ed-33a2f4469cde None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:51.383211 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911243e4-9434-417e-b3be-29064630078e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:51.383211 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911243e4-9434-417e-b3be-29064630078e None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:51.383211 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911243e4-9434-417e-b3be-29064630078e None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:51.383211 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911243e4-9434-417e-b3be-29064630078e None admin] PATH_INFO: `/v3/projects/d40f8877192d4e139c6e3bd259c38e25` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:51.383632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911243e4-9434-417e-b3be-29064630078e None admin] RBAC: Authorizing `identity:get_project(project_id=d40f8877192d4e139c6e3bd259c38e25)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:51.383632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911243e4-9434-417e-b3be-29064630078e None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:51.384242 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 89/179] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:12:51 2022] GET /identity/v3/projects/d40f8877192d4e139c6e3bd259c38e25 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:51.390399 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918bc24e-b3c1-49ce-9d9a-c2ff8804c659 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:51.501173 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28129256-39ca-4bd2-b977-a0c6898c8e0a None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:51.501525 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28129256-39ca-4bd2-b977-a0c6898c8e0a None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:51.501723 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28129256-39ca-4bd2-b977-a0c6898c8e0a None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:51.503515 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 90/180] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 20:12:51.508903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14def2-9905-4998-9c84-58194d35acbe None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:51.509202 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14def2-9905-4998-9c84-58194d35acbe None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:51.509466 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14def2-9905-4998-9c84-58194d35acbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:51.544383 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918bc24e-b3c1-49ce-9d9a-c2ff8804c659 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:51.544575 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-7a14def2-9905-4998-9c84-58194d35acbe None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:51.545931 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-7a14def2-9905-4998-9c84-58194d35acbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:51.599481 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c4335-7c91-4d60-967b-f97671f1ad64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:51.600212 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c4335-7c91-4d60-967b-f97671f1ad64 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:51.600504 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c4335-7c91-4d60-967b-f97671f1ad64 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:51.600782 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c4335-7c91-4d60-967b-f97671f1ad64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:51.601580 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c4335-7c91-4d60-967b-f97671f1ad64 None admin] RBAC: Adding query filter params (role.id=b63f862c45f24bd8856021d73b8fa0e2, scope.project.id=d40f8877192d4e139c6e3bd259c38e25, user.id=5f1e12dbf11d4d17913d66e0e88d33c8) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:51.601890 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c4335-7c91-4d60-967b-f97671f1ad64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:51.603379 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c4335-7c91-4d60-967b-f97671f1ad64 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:51.605902 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:51.611655 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 91/181] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:12:51 2022] GET /identity/v3/role_assignments?user.id=5f1e12dbf11d4d17913d66e0e88d33c8&scope.project.id=d40f8877192d4e139c6e3bd259c38e25&role.id=b63f862c45f24bd8856021d73b8fa0e2 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:51.675967 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 91/182] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 20:12:51.726030 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c4335-7c91-4d60-967b-f97671f1ad64 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:51.859359 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c4335-7c91-4d60-967b-f97671f1ad64 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:51.897013 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf56437-a81e-4452-8bc5-9a7d244780cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:51.897736 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf56437-a81e-4452-8bc5-9a7d244780cd None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:51.898020 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf56437-a81e-4452-8bc5-9a7d244780cd None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:51.898298 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf56437-a81e-4452-8bc5-9a7d244780cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:51.911219 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf56437-a81e-4452-8bc5-9a7d244780cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:12:51.916675 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-6bf56437-a81e-4452-8bc5-9a7d244780cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:12:51.916675 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:12:51.916675 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:12:51.916675 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:12:51.916675 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:12:51.916675 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:12:51.916675 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:12:51.916675 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:12:51.916675 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:12:51.916675 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:12:51.916675 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:12:51.916675 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:12:51.916675 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:12:51.916675 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:12:51.916675 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:12:51.916675 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:12:51.919314 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:12:51.919314 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:12:51.919314 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:12:51.919314 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:12:51.919314 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:12:51.919314 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:12:51.919314 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:12:51.919314 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:12:51.919314 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:12:51.919314 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:12:51.919314 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:12:51.919314 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:12:51.919314 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:12:51.919314 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:12:51.919314 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:12:51.919314 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:12:51.920871 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:12:51.920871 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:12:51.920871 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:12:51.920871 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:12:51.920871 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:12:51.920871 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:12:51.920871 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:12:51.920871 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:12:51.920871 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:12:51.920871 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:12:51.920871 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:12:51.920871 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:12:51.920871 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 92/183] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 27 20:12:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:12:51.928445 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14def2-9905-4998-9c84-58194d35acbe None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:51.937904 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc78cf-e008-496b-a03e-82ef5f31196d None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:51.938208 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc78cf-e008-496b-a03e-82ef5f31196d None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:51.938546 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc78cf-e008-496b-a03e-82ef5f31196d None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:51.940204 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 93/184] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:51.945528 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84154e6-4c9f-4dab-b462-9687e11b9474 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:51.945812 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84154e6-4c9f-4dab-b462-9687e11b9474 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:51.946089 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84154e6-4c9f-4dab-b462-9687e11b9474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:51.966972 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-c84154e6-4c9f-4dab-b462-9687e11b9474 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:51.968280 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-c84154e6-4c9f-4dab-b462-9687e11b9474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:52.012930 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:52.038198 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:52.062677 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 94/185] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:52.077494 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14def2-9905-4998-9c84-58194d35acbe None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:52.087613 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84154e6-4c9f-4dab-b462-9687e11b9474 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:52.118400 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c004e3a-0ac4-42a6-bb8b-2ea8984f2162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:52.119553 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c004e3a-0ac4-42a6-bb8b-2ea8984f2162 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:52.119842 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c004e3a-0ac4-42a6-bb8b-2ea8984f2162 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:52.120117 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c004e3a-0ac4-42a6-bb8b-2ea8984f2162 None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:52.120890 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c004e3a-0ac4-42a6-bb8b-2ea8984f2162 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:52.121202 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c004e3a-0ac4-42a6-bb8b-2ea8984f2162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:52.122699 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c004e3a-0ac4-42a6-bb8b-2ea8984f2162 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:52.133450 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 92/186] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:12:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:52.140193 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c004e3a-0ac4-42a6-bb8b-2ea8984f2162 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:52.218937 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84154e6-4c9f-4dab-b462-9687e11b9474 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:52.259674 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85401b-366f-44d6-8150-46a3cd80a1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:52.260768 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85401b-366f-44d6-8150-46a3cd80a1c5 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:52.261824 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85401b-366f-44d6-8150-46a3cd80a1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:52.262297 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85401b-366f-44d6-8150-46a3cd80a1c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:52.264501 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c004e3a-0ac4-42a6-bb8b-2ea8984f2162 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:52.273897 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85401b-366f-44d6-8150-46a3cd80a1c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:12:52.280405 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-ca85401b-366f-44d6-8150-46a3cd80a1c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 20:12:52.280405 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:12:52.280405 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:12:52.280405 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:12:52.280405 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:12:52.280405 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:12:52.280405 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:12:52.280405 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:12:52.280405 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:12:52.280405 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:12:52.280405 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:12:52.280405 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:12:52.280405 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:12:52.280405 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:12:52.280405 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:12:52.280405 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:12:52.281266 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:12:52.281266 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:12:52.281266 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:12:52.281266 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:12:52.281266 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:12:52.281266 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:12:52.281266 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:12:52.281266 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:12:52.281266 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:12:52.281266 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:12:52.281266 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:12:52.281266 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:12:52.281266 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:12:52.281266 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:12:52.281266 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:12:52.281266 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:12:52.282060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:12:52.282060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:12:52.282060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:12:52.282060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:12:52.282060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:12:52.282060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:12:52.282060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:12:52.282060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:12:52.282060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:12:52.282060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:12:52.282060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 20:12:52.282060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:12:52.283414 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:52.285262 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 95/187] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 27 20:12:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:12:52.292267 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85401b-366f-44d6-8150-46a3cd80a1c5 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:52.303983 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69559edb-965b-453b-8413-8c18f67fe4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:52.304637 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69559edb-965b-453b-8413-8c18f67fe4c8 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:52.304922 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69559edb-965b-453b-8413-8c18f67fe4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:52.305195 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69559edb-965b-453b-8413-8c18f67fe4c8 None admin] PATH_INFO: `/v3/users/9e291530f7054a9b9365039a5542ab0d` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:52.320954 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69559edb-965b-453b-8413-8c18f67fe4c8 None admin] RBAC: Authorizing `identity:get_user(user_id=9e291530f7054a9b9365039a5542ab0d)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:52.322426 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69559edb-965b-453b-8413-8c18f67fe4c8 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:52.325339 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 93/188] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:12:52 2022] GET /identity/v3/users/9e291530f7054a9b9365039a5542ab0d => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:12:52.330668 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69559edb-965b-453b-8413-8c18f67fe4c8 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:52.364710 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:52.424581 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85401b-366f-44d6-8150-46a3cd80a1c5 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:52.452002 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69559edb-965b-453b-8413-8c18f67fe4c8 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:52.463714 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250813a-18fe-47d8-bbc0-36e4b08d90a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:52.464332 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250813a-18fe-47d8-bbc0-36e4b08d90a4 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:52.464639 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250813a-18fe-47d8-bbc0-36e4b08d90a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:52.464912 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250813a-18fe-47d8-bbc0-36e4b08d90a4 None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:52.465618 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250813a-18fe-47d8-bbc0-36e4b08d90a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:52.465923 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250813a-18fe-47d8-bbc0-36e4b08d90a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:52.467329 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250813a-18fe-47d8-bbc0-36e4b08d90a4 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:52.475378 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 96/189] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:12:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:52.476603 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0b0f0-91f0-4fd1-b11a-e4f401f109ed None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:52.476889 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0b0f0-91f0-4fd1-b11a-e4f401f109ed None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:52.477160 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0b0f0-91f0-4fd1-b11a-e4f401f109ed None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:52.478518 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 97/190] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:52.483321 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0b0f0-91f0-4fd1-b11a-e4f401f109ed None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:52.492227 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e44977-387b-483e-8f78-a82dbc9930ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:52.493055 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e44977-387b-483e-8f78-a82dbc9930ec None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:52.493483 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e44977-387b-483e-8f78-a82dbc9930ec None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:52.493897 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e44977-387b-483e-8f78-a82dbc9930ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:52.543206 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:52.568102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e44977-387b-483e-8f78-a82dbc9930ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:52.569896 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e44977-387b-483e-8f78-a82dbc9930ec None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:52.593541 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0b0f0-91f0-4fd1-b11a-e4f401f109ed None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:52.605203 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:52.632652 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69a902-3ff0-4305-943f-e64db742b7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:52.633271 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69a902-3ff0-4305-943f-e64db742b7a6 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:52.633553 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69a902-3ff0-4305-943f-e64db742b7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:52.633833 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69a902-3ff0-4305-943f-e64db742b7a6 None admin] PATH_INFO: `/v3/users/9e291530f7054a9b9365039a5542ab0d` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:52.635019 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69a902-3ff0-4305-943f-e64db742b7a6 None admin] RBAC: Authorizing `identity:get_user(user_id=9e291530f7054a9b9365039a5542ab0d)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:52.637049 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69a902-3ff0-4305-943f-e64db742b7a6 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:52.638662 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 98/191] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:12:52 2022] GET /identity/v3/users/9e291530f7054a9b9365039a5542ab0d => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:52.639820 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abb98d-af5f-4717-b97b-b20beec45f42 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:52.640104 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abb98d-af5f-4717-b97b-b20beec45f42 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:52.640375 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abb98d-af5f-4717-b97b-b20beec45f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:52.660148 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-c5abb98d-af5f-4717-b97b-b20beec45f42 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:52.661362 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-c5abb98d-af5f-4717-b97b-b20beec45f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:52.684659 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 94/192] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:12:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 20:12:52.685955 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e44977-387b-483e-8f78-a82dbc9930ec None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:52.735593 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 99/193] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:52.736743 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5abb98d-af5f-4717-b97b-b20beec45f42 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:52.773940 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:52.799724 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e44977-387b-483e-8f78-a82dbc9930ec None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:52.836562 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbdd21-5b27-448f-a824-edb3fb15bacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:52.837189 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbdd21-5b27-448f-a824-edb3fb15bacf None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:52.837462 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbdd21-5b27-448f-a824-edb3fb15bacf None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:52.837739 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbdd21-5b27-448f-a824-edb3fb15bacf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:52.856133 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5abb98d-af5f-4717-b97b-b20beec45f42 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:52.869219 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:52.896718 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69170e5c-d2bb-4c6d-96ab-c1b2d28f7c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:52.897399 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69170e5c-d2bb-4c6d-96ab-c1b2d28f7c7c None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:52.897731 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69170e5c-d2bb-4c6d-96ab-c1b2d28f7c7c None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:52.898367 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69170e5c-d2bb-4c6d-96ab-c1b2d28f7c7c None admin] PATH_INFO: `/v3/projects/79b53610ba784f5e9b4c8b6b96c30024` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:52.899485 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69170e5c-d2bb-4c6d-96ab-c1b2d28f7c7c None admin] RBAC: Authorizing `identity:get_project(project_id=79b53610ba784f5e9b4c8b6b96c30024)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:52.901187 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69170e5c-d2bb-4c6d-96ab-c1b2d28f7c7c None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:52.902882 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 100/194] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:12:52 2022] GET /identity/v3/projects/79b53610ba784f5e9b4c8b6b96c30024 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:52.908280 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69170e5c-d2bb-4c6d-96ab-c1b2d28f7c7c None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:52.911164 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbdd21-5b27-448f-a824-edb3fb15bacf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:52.912631 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbdd21-5b27-448f-a824-edb3fb15bacf None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:52.993948 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:53.013287 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69170e5c-d2bb-4c6d-96ab-c1b2d28f7c7c None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:53.019529 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 95/195] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:12:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:53.020185 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbdd21-5b27-448f-a824-edb3fb15bacf None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:53.056499 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cacb3e-78cb-4bc3-a970-2a8a47db9005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:53.057265 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cacb3e-78cb-4bc3-a970-2a8a47db9005 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:53.057606 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cacb3e-78cb-4bc3-a970-2a8a47db9005 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:53.057939 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cacb3e-78cb-4bc3-a970-2a8a47db9005 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:53.059793 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cacb3e-78cb-4bc3-a970-2a8a47db9005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:53.061305 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cacb3e-78cb-4bc3-a970-2a8a47db9005 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:53.062982 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 101/196] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:12:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:53.068626 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cacb3e-78cb-4bc3-a970-2a8a47db9005 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:53.117569 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:53.126746 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbdd21-5b27-448f-a824-edb3fb15bacf None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:53.160710 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd426782-699f-4f3d-bea7-aa2bd28c8b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:53.161336 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd426782-699f-4f3d-bea7-aa2bd28c8b24 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:53.161617 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd426782-699f-4f3d-bea7-aa2bd28c8b24 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:53.161895 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd426782-699f-4f3d-bea7-aa2bd28c8b24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:53.162682 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd426782-699f-4f3d-bea7-aa2bd28c8b24 None admin] RBAC: Adding query filter params (role.id=df8ec36d044b469d8854eba8394eb107, scope.project.id=79b53610ba784f5e9b4c8b6b96c30024, user.id=9e291530f7054a9b9365039a5542ab0d) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:53.162995 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd426782-699f-4f3d-bea7-aa2bd28c8b24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:53.164481 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd426782-699f-4f3d-bea7-aa2bd28c8b24 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:53.170461 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 96/197] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:12:53 2022] GET /identity/v3/role_assignments?user.id=9e291530f7054a9b9365039a5542ab0d&scope.project.id=79b53610ba784f5e9b4c8b6b96c30024&role.id=df8ec36d044b469d8854eba8394eb107 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:53.171269 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd426782-699f-4f3d-bea7-aa2bd28c8b24 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:53.192287 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cacb3e-78cb-4bc3-a970-2a8a47db9005 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:53.225084 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:53.234650 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469d861-2432-4bea-bd48-1b3e6f8b0475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:53.235509 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469d861-2432-4bea-bd48-1b3e6f8b0475 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:53.235916 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469d861-2432-4bea-bd48-1b3e6f8b0475 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:53.236284 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469d861-2432-4bea-bd48-1b3e6f8b0475 None admin] PATH_INFO: `/v3/projects/79b53610ba784f5e9b4c8b6b96c30024` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:53.237660 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469d861-2432-4bea-bd48-1b3e6f8b0475 None admin] RBAC: Authorizing `identity:get_project(project_id=79b53610ba784f5e9b4c8b6b96c30024)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:53.239320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469d861-2432-4bea-bd48-1b3e6f8b0475 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:53.241411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 102/198] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:12:53 2022] GET /identity/v3/projects/79b53610ba784f5e9b4c8b6b96c30024 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:53.242585 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bd062-7d99-4c2d-b59d-1e4a6d00edbb None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:53.242932 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bd062-7d99-4c2d-b59d-1e4a6d00edbb None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:53.243293 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bd062-7d99-4c2d-b59d-1e4a6d00edbb None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:53.244628 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 103/199] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:53.248837 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bd062-7d99-4c2d-b59d-1e4a6d00edbb None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:53.294788 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd426782-699f-4f3d-bea7-aa2bd28c8b24 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:53.341085 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3d6a8-d888-4f6f-9428-03e829bb0721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:53.341723 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3d6a8-d888-4f6f-9428-03e829bb0721 None admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:53.342007 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3d6a8-d888-4f6f-9428-03e829bb0721 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:53.342282 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3d6a8-d888-4f6f-9428-03e829bb0721 None admin] PATH_INFO: `/v3/users` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:53.342989 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3d6a8-d888-4f6f-9428-03e829bb0721 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:53.344507 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3d6a8-d888-4f6f-9428-03e829bb0721 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:53.372746 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bd062-7d99-4c2d-b59d-1e4a6d00edbb None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:53.373833 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 97/200] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 27 20:12:53 2022] POST /identity/v3/users => generated 297 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:12:53.385534 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13ea7f-f993-47dd-831c-ab32485f2ecc None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:53.386469 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13ea7f-f993-47dd-831c-ab32485f2ecc None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:53.386986 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13ea7f-f993-47dd-831c-ab32485f2ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:53.399524 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:53.414034 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-cd13ea7f-f993-47dd-831c-ab32485f2ecc None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:53.415370 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd84399-2fad-4804-9469-c7355f0cc0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:53.416007 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-cd13ea7f-f993-47dd-831c-ab32485f2ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:53.416135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd84399-2fad-4804-9469-c7355f0cc0d3 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:53.416584 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd84399-2fad-4804-9469-c7355f0cc0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:53.416869 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd84399-2fad-4804-9469-c7355f0cc0d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:53.418505 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd84399-2fad-4804-9469-c7355f0cc0d3 None admin] RBAC: Adding query filter params (role.id=b63f862c45f24bd8856021d73b8fa0e2, scope.project.id=79b53610ba784f5e9b4c8b6b96c30024, user.id=9e291530f7054a9b9365039a5542ab0d) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:53.418887 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd84399-2fad-4804-9469-c7355f0cc0d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:53.420548 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd84399-2fad-4804-9469-c7355f0cc0d3 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:53.427809 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 104/201] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:12:53 2022] GET /identity/v3/role_assignments?user.id=9e291530f7054a9b9365039a5542ab0d&scope.project.id=79b53610ba784f5e9b4c8b6b96c30024&role.id=b63f862c45f24bd8856021d73b8fa0e2 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:53.500986 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 98/202] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:53.528672 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd84399-2fad-4804-9469-c7355f0cc0d3 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:53.647862 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd84399-2fad-4804-9469-c7355f0cc0d3 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:53.691420 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6969e02-e992-4cf9-92df-ff2d70ac02c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:53.692486 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6969e02-e992-4cf9-92df-ff2d70ac02c4 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:53.692994 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6969e02-e992-4cf9-92df-ff2d70ac02c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:53.693476 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6969e02-e992-4cf9-92df-ff2d70ac02c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:53.705155 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6969e02-e992-4cf9-92df-ff2d70ac02c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:12:53.710908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-f6969e02-e992-4cf9-92df-ff2d70ac02c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 20:12:53.710908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:12:53.710908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:12:53.710908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:12:53.710908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:12:53.710908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:12:53.710908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:12:53.710908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:12:53.710908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:12:53.710908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:12:53.710908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:12:53.710908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:12:53.710908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:12:53.710908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:12:53.710908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:12:53.710908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:12:53.711923 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:12:53.711923 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:12:53.711923 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:12:53.711923 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:12:53.711923 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:12:53.711923 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:12:53.711923 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:12:53.711923 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:12:53.711923 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:12:53.711923 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:12:53.711923 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:12:53.711923 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:12:53.711923 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:12:53.711923 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:12:53.711923 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:12:53.711923 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:12:53.712730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:12:53.712730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:12:53.712730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:12:53.712730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:12:53.712730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:12:53.712730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:12:53.712730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:12:53.712730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:12:53.712730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:12:53.712730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:12:53.712730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 20:12:53.712730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:12:53.713841 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 105/203] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:12:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:12:53.723232 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13ea7f-f993-47dd-831c-ab32485f2ecc None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:53.758129 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:53.848203 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13ea7f-f993-47dd-831c-ab32485f2ecc None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:53.884906 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8023b-fc6b-41b0-aaa8-fe0bc069e7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:53.885531 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8023b-fc6b-41b0-aaa8-fe0bc069e7ed None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:53.885807 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8023b-fc6b-41b0-aaa8-fe0bc069e7ed None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:53.886074 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8023b-fc6b-41b0-aaa8-fe0bc069e7ed None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:53.887374 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8023b-fc6b-41b0-aaa8-fe0bc069e7ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:53.887677 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8023b-fc6b-41b0-aaa8-fe0bc069e7ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:53.889059 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8023b-fc6b-41b0-aaa8-fe0bc069e7ed None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:53.898057 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 99/204] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:12:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:53.904138 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6969e02-e992-4cf9-92df-ff2d70ac02c4 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:53.942506 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:54.026697 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6969e02-e992-4cf9-92df-ff2d70ac02c4 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:54.062253 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63853e40-b34c-4ff6-a02b-be56c8056bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:54.062898 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63853e40-b34c-4ff6-a02b-be56c8056bfc None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:54.063285 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63853e40-b34c-4ff6-a02b-be56c8056bfc None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:54.063565 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63853e40-b34c-4ff6-a02b-be56c8056bfc None admin] PATH_INFO: `/v3/users/e9603751a9ac4782a76ded03a6d72998` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:54.064828 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63853e40-b34c-4ff6-a02b-be56c8056bfc None admin] RBAC: Authorizing `identity:get_user(user_id=e9603751a9ac4782a76ded03a6d72998)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:54.066401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63853e40-b34c-4ff6-a02b-be56c8056bfc None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:54.068344 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 106/205] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:12:53 2022] GET /identity/v3/users/e9603751a9ac4782a76ded03a6d72998 => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:54.074609 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8023b-fc6b-41b0-aaa8-fe0bc069e7ed None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:54.185337 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:54.204433 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8023b-fc6b-41b0-aaa8-fe0bc069e7ed None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:54.249927 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8627512-68c2-4c99-9ce2-99a52468d394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:54.250560 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8627512-68c2-4c99-9ce2-99a52468d394 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:54.250846 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8627512-68c2-4c99-9ce2-99a52468d394 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:54.251147 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8627512-68c2-4c99-9ce2-99a52468d394 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:54.348279 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8627512-68c2-4c99-9ce2-99a52468d394 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:54.350941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8627512-68c2-4c99-9ce2-99a52468d394 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:54.483052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:54.502336 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 100/206] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:12:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:54.508078 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63853e40-b34c-4ff6-a02b-be56c8056bfc None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:54.631646 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63853e40-b34c-4ff6-a02b-be56c8056bfc None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:54.633906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:54.793190 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec30e75-4812-4330-bd5f-ebc3ffa92924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:54.793852 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec30e75-4812-4330-bd5f-ebc3ffa92924 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:54.794134 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec30e75-4812-4330-bd5f-ebc3ffa92924 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:54.794408 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec30e75-4812-4330-bd5f-ebc3ffa92924 None admin] PATH_INFO: `/v3/projects/d40f8877192d4e139c6e3bd259c38e25` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:54.795650 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec30e75-4812-4330-bd5f-ebc3ffa92924 None admin] RBAC: Authorizing `identity:get_project(project_id=d40f8877192d4e139c6e3bd259c38e25)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:54.797102 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec30e75-4812-4330-bd5f-ebc3ffa92924 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:54.799216 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 107/207] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:12:54 2022] GET /identity/v3/projects/d40f8877192d4e139c6e3bd259c38e25 => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:54.805295 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8627512-68c2-4c99-9ce2-99a52468d394 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:54.923946 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8627512-68c2-4c99-9ce2-99a52468d394 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:54.972637 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cd759-0f0d-4cd5-b20f-d51e16c313a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:54.973259 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cd759-0f0d-4cd5-b20f-d51e16c313a6 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:54.973542 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cd759-0f0d-4cd5-b20f-d51e16c313a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:54.973814 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cd759-0f0d-4cd5-b20f-d51e16c313a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:54.974599 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cd759-0f0d-4cd5-b20f-d51e16c313a6 None admin] RBAC: Adding query filter params (role.id=b166adb7927b4a9fbd2ade12fa51de68, scope.project.id=d40f8877192d4e139c6e3bd259c38e25, user.id=e9603751a9ac4782a76ded03a6d72998) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:54.974909 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cd759-0f0d-4cd5-b20f-d51e16c313a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:54.976388 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cd759-0f0d-4cd5-b20f-d51e16c313a6 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:54.984748 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 101/208] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:12:54 2022] GET /identity/v3/role_assignments?user.id=e9603751a9ac4782a76ded03a6d72998&scope.project.id=d40f8877192d4e139c6e3bd259c38e25&role.id=b166adb7927b4a9fbd2ade12fa51de68 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:55.760773 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba68e0-465b-46e5-856d-64e7de4c03c3 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:55.761807 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba68e0-465b-46e5-856d-64e7de4c03c3 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:55.761807 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba68e0-465b-46e5-856d-64e7de4c03c3 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:55.763612 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 108/209] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:55.769252 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93aaa14-666d-4173-a990-0e84c81da4ee None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:55.769646 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93aaa14-666d-4173-a990-0e84c81da4ee None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:55.769807 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93aaa14-666d-4173-a990-0e84c81da4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:55.788676 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-b93aaa14-666d-4173-a990-0e84c81da4ee None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:55.789872 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-b93aaa14-666d-4173-a990-0e84c81da4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:55.843170 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:55.874651 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 102/210] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:55.898406 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba68e0-465b-46e5-856d-64e7de4c03c3 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:56.004290 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba68e0-465b-46e5-856d-64e7de4c03c3 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:56.013137 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a556926-79eb-499b-b03d-30f1e0211ee6 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:56.013346 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a556926-79eb-499b-b03d-30f1e0211ee6 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:56.013826 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a556926-79eb-499b-b03d-30f1e0211ee6 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:56.015215 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 103/211] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:56.020506 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0888f7-96ec-4e69-a0df-d077436a3e3e None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:56.021048 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0888f7-96ec-4e69-a0df-d077436a3e3e None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:56.021520 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0888f7-96ec-4e69-a0df-d077436a3e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:56.040568 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-6a0888f7-96ec-4e69-a0df-d077436a3e3e None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:56.042067 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-6a0888f7-96ec-4e69-a0df-d077436a3e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:56.043820 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b4b0d-2aa2-4330-9093-b827390b50a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:56.044583 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b4b0d-2aa2-4330-9093-b827390b50a6 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:56.044860 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b4b0d-2aa2-4330-9093-b827390b50a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:56.045130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b4b0d-2aa2-4330-9093-b827390b50a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:56.056677 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b4b0d-2aa2-4330-9093-b827390b50a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:12:56.062597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-473b4b0d-2aa2-4330-9093-b827390b50a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:12:56.062597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:12:56.062597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:12:56.062597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:12:56.062597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:12:56.062597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:12:56.062597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:12:56.062597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:12:56.062597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:12:56.062597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:12:56.062597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:12:56.062597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:12:56.062597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:12:56.062597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:12:56.062597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:12:56.062597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:12:56.063534 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:12:56.063534 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:12:56.063534 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:12:56.063534 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:12:56.063534 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:12:56.063534 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:12:56.063534 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:12:56.063534 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:12:56.063534 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:12:56.063534 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:12:56.063534 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:12:56.063534 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:12:56.063534 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:12:56.063534 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:12:56.063534 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:12:56.063534 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:12:56.064657 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:12:56.064657 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:12:56.064657 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:12:56.064657 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:12:56.064657 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:12:56.064657 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:12:56.064657 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:12:56.064657 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:12:56.064657 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:12:56.064657 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:12:56.064657 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:12:56.064657 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:12:56.064657 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 109/212] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 27 20:12:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:12:56.072249 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b4b0d-2aa2-4330-9093-b827390b50a6 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:56.114096 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:56.128362 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 104/213] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:56.158728 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0888f7-96ec-4e69-a0df-d077436a3e3e None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:56.203940 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b4b0d-2aa2-4330-9093-b827390b50a6 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:56.249044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f469777-dade-4558-8836-a9235f518e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:56.249690 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f469777-dade-4558-8836-a9235f518e97 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:56.249999 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f469777-dade-4558-8836-a9235f518e97 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:56.250868 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f469777-dade-4558-8836-a9235f518e97 None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:56.251698 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f469777-dade-4558-8836-a9235f518e97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:56.252011 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f469777-dade-4558-8836-a9235f518e97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:56.254448 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f469777-dade-4558-8836-a9235f518e97 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:56.271357 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 110/214] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:12:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:12:56.274266 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f469777-dade-4558-8836-a9235f518e97 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:56.286662 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0888f7-96ec-4e69-a0df-d077436a3e3e None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:56.309544 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:56.343220 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a5239-eadd-4c63-b8ad-caeaf8925db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:56.344379 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a5239-eadd-4c63-b8ad-caeaf8925db4 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:56.344895 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a5239-eadd-4c63-b8ad-caeaf8925db4 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:56.345628 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a5239-eadd-4c63-b8ad-caeaf8925db4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:56.360020 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a5239-eadd-4c63-b8ad-caeaf8925db4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:12:56.366480 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-e57a5239-eadd-4c63-b8ad-caeaf8925db4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 20:12:56.366480 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:12:56.366480 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:12:56.366480 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:12:56.366480 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:12:56.366480 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:12:56.366480 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:12:56.366480 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:12:56.366480 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:12:56.366480 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:12:56.366480 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:12:56.366480 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:12:56.366480 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:12:56.366480 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:12:56.366480 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:12:56.366480 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:12:56.367414 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:12:56.367414 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:12:56.367414 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:12:56.367414 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:12:56.367414 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:12:56.367414 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:12:56.367414 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:12:56.367414 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:12:56.367414 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:12:56.367414 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:12:56.367414 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:12:56.367414 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:12:56.367414 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:12:56.367414 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:12:56.367414 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:12:56.367414 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:12:56.368203 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:12:56.368203 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:12:56.368203 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:12:56.368203 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:12:56.368203 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:12:56.368203 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:12:56.368203 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:12:56.368203 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:12:56.368203 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:12:56.368203 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:12:56.368203 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 20:12:56.368203 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:12:56.371490 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 105/215] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 27 20:12:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:12:56.377478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a5239-eadd-4c63-b8ad-caeaf8925db4 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:56.402062 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:56.410678 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f469777-dade-4558-8836-a9235f518e97 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:56.448164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bc11b-d9c1-4480-b9cd-0e61dc5f9871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:56.449325 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bc11b-d9c1-4480-b9cd-0e61dc5f9871 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:56.449644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bc11b-d9c1-4480-b9cd-0e61dc5f9871 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:56.449883 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bc11b-d9c1-4480-b9cd-0e61dc5f9871 None admin] PATH_INFO: `/v3/users/9e291530f7054a9b9365039a5542ab0d` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:56.451193 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bc11b-d9c1-4480-b9cd-0e61dc5f9871 None admin] RBAC: Authorizing `identity:get_user(user_id=9e291530f7054a9b9365039a5542ab0d)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:56.452639 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bc11b-d9c1-4480-b9cd-0e61dc5f9871 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:56.458744 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 111/216] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:12:56 2022] GET /identity/v3/users/9e291530f7054a9b9365039a5542ab0d => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:56.458744 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848836a0-a8f9-4b96-9ddc-2a0e8fc91531 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:56.458744 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848836a0-a8f9-4b96-9ddc-2a0e8fc91531 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:56.458744 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848836a0-a8f9-4b96-9ddc-2a0e8fc91531 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:56.458744 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 112/217] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:56.461813 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848836a0-a8f9-4b96-9ddc-2a0e8fc91531 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:56.493551 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a5239-eadd-4c63-b8ad-caeaf8925db4 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:56.526568 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aaeea3-8798-4b78-bfa3-f56db18f72da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:56.528097 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aaeea3-8798-4b78-bfa3-f56db18f72da None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:56.528377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aaeea3-8798-4b78-bfa3-f56db18f72da None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:56.528647 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aaeea3-8798-4b78-bfa3-f56db18f72da None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:56.529349 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aaeea3-8798-4b78-bfa3-f56db18f72da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:56.529651 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aaeea3-8798-4b78-bfa3-f56db18f72da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:56.531014 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aaeea3-8798-4b78-bfa3-f56db18f72da None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:56.538754 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 106/218] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:12:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:56.540092 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15638bb8-cdc3-40bb-b0d8-e8cc8f36d6c3 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:56.540406 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15638bb8-cdc3-40bb-b0d8-e8cc8f36d6c3 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:56.540686 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15638bb8-cdc3-40bb-b0d8-e8cc8f36d6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:56.557885 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-15638bb8-cdc3-40bb-b0d8-e8cc8f36d6c3 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:56.559126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-15638bb8-cdc3-40bb-b0d8-e8cc8f36d6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:56.565220 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848836a0-a8f9-4b96-9ddc-2a0e8fc91531 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:56.585277 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:56.600148 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e972c-6782-4ceb-ae40-09587022ab6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:56.600773 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e972c-6782-4ceb-ae40-09587022ab6c None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:56.601045 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e972c-6782-4ceb-ae40-09587022ab6c None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:56.601311 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e972c-6782-4ceb-ae40-09587022ab6c None admin] PATH_INFO: `/v3/projects/79b53610ba784f5e9b4c8b6b96c30024` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:56.602435 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e972c-6782-4ceb-ae40-09587022ab6c None admin] RBAC: Authorizing `identity:get_project(project_id=79b53610ba784f5e9b4c8b6b96c30024)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:56.603961 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e972c-6782-4ceb-ae40-09587022ab6c None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:56.605530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 113/219] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:12:56 2022] GET /identity/v3/projects/79b53610ba784f5e9b4c8b6b96c30024 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:56.606635 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db822ac-915a-4e53-81ed-79820592e229 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:56.606912 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db822ac-915a-4e53-81ed-79820592e229 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:56.607219 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db822ac-915a-4e53-81ed-79820592e229 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:56.608408 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 114/220] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:56.612199 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db822ac-915a-4e53-81ed-79820592e229 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:56.627669 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 107/221] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:56.636492 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15638bb8-cdc3-40bb-b0d8-e8cc8f36d6c3 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:56.642596 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:56.713359 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db822ac-915a-4e53-81ed-79820592e229 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:56.735222 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15638bb8-cdc3-40bb-b0d8-e8cc8f36d6c3 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:56.747028 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08373956-dfa8-4d64-9bea-625807840bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:56.747685 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08373956-dfa8-4d64-9bea-625807840bae None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:56.747960 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08373956-dfa8-4d64-9bea-625807840bae None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:56.748258 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08373956-dfa8-4d64-9bea-625807840bae None admin] PATH_INFO: `/v3/users/9e291530f7054a9b9365039a5542ab0d` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:56.749408 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08373956-dfa8-4d64-9bea-625807840bae None admin] RBAC: Authorizing `identity:get_user(user_id=9e291530f7054a9b9365039a5542ab0d)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:56.750835 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08373956-dfa8-4d64-9bea-625807840bae None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:56.752522 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 115/222] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:12:56 2022] GET /identity/v3/users/9e291530f7054a9b9365039a5542ab0d => generated 283 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:56.753952 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2fdf5-0abe-4320-a6af-98a12aca1c0f None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:56.754233 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2fdf5-0abe-4320-a6af-98a12aca1c0f None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:56.754504 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2fdf5-0abe-4320-a6af-98a12aca1c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:56.771336 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbdece-2336-4f72-9d98-62658a269dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:56.771905 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-dea2fdf5-0abe-4320-a6af-98a12aca1c0f None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:56.772261 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbdece-2336-4f72-9d98-62658a269dc4 None admin] REQUEST_METHOD: `PUT` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:56.772261 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbdece-2336-4f72-9d98-62658a269dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:56.772531 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbdece-2336-4f72-9d98-62658a269dc4 None admin] PATH_INFO: `/v3/projects/79b53610ba784f5e9b4c8b6b96c30024/users/9e291530f7054a9b9365039a5542ab0d/roles/df8ec36d044b469d8854eba8394eb107` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:56.773082 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-dea2fdf5-0abe-4320-a6af-98a12aca1c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:56.774457 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbdece-2336-4f72-9d98-62658a269dc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=79b53610ba784f5e9b4c8b6b96c30024, user_id=9e291530f7054a9b9365039a5542ab0d, role_id=df8ec36d044b469d8854eba8394eb107)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:56.775931 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbdece-2336-4f72-9d98-62658a269dc4 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:56.790324 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 108/223] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 27 20:12:56 2022] PUT /identity/v3/projects/79b53610ba784f5e9b4c8b6b96c30024/users/9e291530f7054a9b9365039a5542ab0d/roles/df8ec36d044b469d8854eba8394eb107 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:12:56.791093 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbdece-2336-4f72-9d98-62658a269dc4 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:56.829188 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:56.857246 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 116/224] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:56.858558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2fdf5-0abe-4320-a6af-98a12aca1c0f None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:56.896781 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:56.991060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2fdf5-0abe-4320-a6af-98a12aca1c0f None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:57.028861 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d925f56-ee02-46ee-bedb-4ad99ccdc31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:57.029505 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d925f56-ee02-46ee-bedb-4ad99ccdc31d None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:57.030131 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d925f56-ee02-46ee-bedb-4ad99ccdc31d None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:57.030412 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d925f56-ee02-46ee-bedb-4ad99ccdc31d None admin] PATH_INFO: `/v3/projects/79b53610ba784f5e9b4c8b6b96c30024` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:57.031600 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d925f56-ee02-46ee-bedb-4ad99ccdc31d None admin] RBAC: Authorizing `identity:get_project(project_id=79b53610ba784f5e9b4c8b6b96c30024)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:57.033046 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d925f56-ee02-46ee-bedb-4ad99ccdc31d None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:57.039108 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 117/225] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:12:56 2022] GET /identity/v3/projects/79b53610ba784f5e9b4c8b6b96c30024 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:57.039108 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d925f56-ee02-46ee-bedb-4ad99ccdc31d None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:57.056113 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbdece-2336-4f72-9d98-62658a269dc4 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:57.094228 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a393822-2742-4e19-a93e-e99187ad113d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:57.094854 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a393822-2742-4e19-a93e-e99187ad113d None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:57.095163 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a393822-2742-4e19-a93e-e99187ad113d None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:57.095438 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a393822-2742-4e19-a93e-e99187ad113d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:57.096809 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a393822-2742-4e19-a93e-e99187ad113d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:57.098258 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a393822-2742-4e19-a93e-e99187ad113d None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:57.104746 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 109/226] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:12:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:57.105366 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a393822-2742-4e19-a93e-e99187ad113d None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:57.133071 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:57.140500 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d925f56-ee02-46ee-bedb-4ad99ccdc31d None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:57.176313 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d519f-b05d-465e-9ad0-c18df440c9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:57.177239 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d519f-b05d-465e-9ad0-c18df440c9de None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:57.177699 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d519f-b05d-465e-9ad0-c18df440c9de None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:57.178149 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d519f-b05d-465e-9ad0-c18df440c9de None admin] PATH_INFO: `/v3/roles/member` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:57.189250 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d519f-b05d-465e-9ad0-c18df440c9de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:12:57.194197 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-250d519f-b05d-465e-9ad0-c18df440c9de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:12:57.194197 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:12:57.194197 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:12:57.194197 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:12:57.194197 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:12:57.194197 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:12:57.194197 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:12:57.194197 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:12:57.194197 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:12:57.194197 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:12:57.194197 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:12:57.194197 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:12:57.194197 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:12:57.194197 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:12:57.194197 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:12:57.194197 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:12:57.195316 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:12:57.195316 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:12:57.195316 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:12:57.195316 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:12:57.195316 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:12:57.195316 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:12:57.195316 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:12:57.195316 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:12:57.195316 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:12:57.195316 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:12:57.195316 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:12:57.195316 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:12:57.195316 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:12:57.195316 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:12:57.195316 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:12:57.195316 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:12:57.196148 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:12:57.196148 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:12:57.196148 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:12:57.196148 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:12:57.196148 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:12:57.196148 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:12:57.196148 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:12:57.196148 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:12:57.196148 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:12:57.196148 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:12:57.196148 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:12:57.196148 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:12:57.196148 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 118/227] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:12:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:12:57.196148 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d519f-b05d-465e-9ad0-c18df440c9de None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:57.211140 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:57.220998 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a393822-2742-4e19-a93e-e99187ad113d None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:57.257815 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78489147-f656-4be8-812e-c538b9519b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:57.258482 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78489147-f656-4be8-812e-c538b9519b58 None admin] REQUEST_METHOD: `PUT` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:57.258856 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78489147-f656-4be8-812e-c538b9519b58 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:57.259030 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78489147-f656-4be8-812e-c538b9519b58 None admin] PATH_INFO: `/v3/projects/79b53610ba784f5e9b4c8b6b96c30024/users/9e291530f7054a9b9365039a5542ab0d/roles/b63f862c45f24bd8856021d73b8fa0e2` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:57.261538 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78489147-f656-4be8-812e-c538b9519b58 None admin] RBAC: Authorizing `identity:create_grant(project_id=79b53610ba784f5e9b4c8b6b96c30024, user_id=9e291530f7054a9b9365039a5542ab0d, role_id=b63f862c45f24bd8856021d73b8fa0e2)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:57.262995 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78489147-f656-4be8-812e-c538b9519b58 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:57.278118 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 110/228] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 27 20:12:57 2022] PUT /identity/v3/projects/79b53610ba784f5e9b4c8b6b96c30024/users/9e291530f7054a9b9365039a5542ab0d/roles/b63f862c45f24bd8856021d73b8fa0e2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:12:57.279274 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78489147-f656-4be8-812e-c538b9519b58 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:57.318345 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d519f-b05d-465e-9ad0-c18df440c9de None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:57.361011 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8457fe-cfd0-40f8-9a5c-b1238a70b575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:57.361784 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8457fe-cfd0-40f8-9a5c-b1238a70b575 None admin] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:57.361979 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8457fe-cfd0-40f8-9a5c-b1238a70b575 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:57.362263 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8457fe-cfd0-40f8-9a5c-b1238a70b575 None admin] PATH_INFO: `/v3/users` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:57.362969 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8457fe-cfd0-40f8-9a5c-b1238a70b575 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:57.364540 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8457fe-cfd0-40f8-9a5c-b1238a70b575 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:57.397253 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 119/229] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 27 20:12:57 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:12:57.432816 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78489147-f656-4be8-812e-c538b9519b58 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:57.473923 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d82f9-7e95-48c1-ac7c-7d20ab5429cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:57.474965 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d82f9-7e95-48c1-ac7c-7d20ab5429cf None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:57.475585 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d82f9-7e95-48c1-ac7c-7d20ab5429cf None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:57.476060 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d82f9-7e95-48c1-ac7c-7d20ab5429cf None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:57.477024 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d82f9-7e95-48c1-ac7c-7d20ab5429cf None admin] RBAC: Adding query filter params (name=member) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:57.477569 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d82f9-7e95-48c1-ac7c-7d20ab5429cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:57.479285 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d82f9-7e95-48c1-ac7c-7d20ab5429cf None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:57.490504 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 111/230] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:12:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:57.497299 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8457fe-cfd0-40f8-9a5c-b1238a70b575 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:57.514311 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:57.612018 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8457fe-cfd0-40f8-9a5c-b1238a70b575 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:57.647162 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a98742-3744-48cb-95fd-c1349bc6e69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:57.647777 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a98742-3744-48cb-95fd-c1349bc6e69e None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:57.648025 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a98742-3744-48cb-95fd-c1349bc6e69e None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:57.648301 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a98742-3744-48cb-95fd-c1349bc6e69e None admin] PATH_INFO: `/v3/users/95a1234a62ea4fab82fc866858fbe371` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:57.663722 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a98742-3744-48cb-95fd-c1349bc6e69e None admin] RBAC: Authorizing `identity:get_user(user_id=95a1234a62ea4fab82fc866858fbe371)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:57.665197 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a98742-3744-48cb-95fd-c1349bc6e69e None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:57.667776 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 120/231] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:12:57 2022] GET /identity/v3/users/95a1234a62ea4fab82fc866858fbe371 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:57.673386 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d82f9-7e95-48c1-ac7c-7d20ab5429cf None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:57.690754 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:57.794117 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d82f9-7e95-48c1-ac7c-7d20ab5429cf None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:57.833567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dae638-2eac-48d5-abaf-a71317f00d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:57.834200 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dae638-2eac-48d5-abaf-a71317f00d57 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:57.834483 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dae638-2eac-48d5-abaf-a71317f00d57 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:57.834757 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dae638-2eac-48d5-abaf-a71317f00d57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:57.913936 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dae638-2eac-48d5-abaf-a71317f00d57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:57.915355 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dae638-2eac-48d5-abaf-a71317f00d57 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:57.931718 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:58.030270 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 112/232] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:12:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 20:12:58.036208 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a98742-3744-48cb-95fd-c1349bc6e69e None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:58.147464 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:58.189953 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a98742-3744-48cb-95fd-c1349bc6e69e None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:58.235771 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b8188-bf89-48e6-972d-7d5d070ff74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:58.236661 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b8188-bf89-48e6-972d-7d5d070ff74c None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:58.237084 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b8188-bf89-48e6-972d-7d5d070ff74c None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:58.237498 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b8188-bf89-48e6-972d-7d5d070ff74c None admin] PATH_INFO: `/v3/projects/79b53610ba784f5e9b4c8b6b96c30024` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:58.238830 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b8188-bf89-48e6-972d-7d5d070ff74c None admin] RBAC: Authorizing `identity:get_project(project_id=79b53610ba784f5e9b4c8b6b96c30024)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:58.240468 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b8188-bf89-48e6-972d-7d5d070ff74c None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:58.242620 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 121/233] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:12:58 2022] GET /identity/v3/projects/79b53610ba784f5e9b4c8b6b96c30024 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:58.248798 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dae638-2eac-48d5-abaf-a71317f00d57 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:58.397252 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dae638-2eac-48d5-abaf-a71317f00d57 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:58.424490 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:58.442910 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f43cd0-bde7-48c9-a3a1-1fe9390c6587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:58.443752 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f43cd0-bde7-48c9-a3a1-1fe9390c6587 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:58.444177 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f43cd0-bde7-48c9-a3a1-1fe9390c6587 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:58.444593 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f43cd0-bde7-48c9-a3a1-1fe9390c6587 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:58.445539 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f43cd0-bde7-48c9-a3a1-1fe9390c6587 None admin] RBAC: Adding query filter params (role.id=13a38ce5696549bf95272ffae43798c8, scope.project.id=79b53610ba784f5e9b4c8b6b96c30024, user.id=95a1234a62ea4fab82fc866858fbe371) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:12:58.446003 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f43cd0-bde7-48c9-a3a1-1fe9390c6587 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:12:58.447689 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f43cd0-bde7-48c9-a3a1-1fe9390c6587 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:12:58.459256 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 113/234] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:12:58 2022] GET /identity/v3/role_assignments?user.id=95a1234a62ea4fab82fc866858fbe371&scope.project.id=79b53610ba784f5e9b4c8b6b96c30024&role.id=13a38ce5696549bf95272ffae43798c8 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:12:59.517210 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025ca5a-e50d-48f5-8716-04f0bba8cd4d None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:59.517741 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025ca5a-e50d-48f5-8716-04f0bba8cd4d None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:59.517741 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025ca5a-e50d-48f5-8716-04f0bba8cd4d None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:59.519367 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 122/235] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:59.524481 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992084e5-135b-4667-8189-9446c409d9a1 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:59.524859 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992084e5-135b-4667-8189-9446c409d9a1 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:59.525034 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992084e5-135b-4667-8189-9446c409d9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:59.543182 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-992084e5-135b-4667-8189-9446c409d9a1 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:59.544357 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-992084e5-135b-4667-8189-9446c409d9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:59.638129 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 114/236] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:59.674083 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025ca5a-e50d-48f5-8716-04f0bba8cd4d None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:59.791843 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025ca5a-e50d-48f5-8716-04f0bba8cd4d None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:12:59.827513 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261cd90-9c49-427d-a4a9-f963ae0181d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:12:59.828156 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261cd90-9c49-427d-a4a9-f963ae0181d4 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:59.828431 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261cd90-9c49-427d-a4a9-f963ae0181d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:59.828702 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261cd90-9c49-427d-a4a9-f963ae0181d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:59.835757 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:59.839795 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4261cd90-9c49-427d-a4a9-f963ae0181d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:12:59.845103 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-4261cd90-9c49-427d-a4a9-f963ae0181d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:12:59.845103 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:12:59.845103 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:12:59.845103 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:12:59.845103 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:12:59.845103 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:12:59.845103 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:12:59.845103 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:12:59.845103 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:12:59.845103 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:12:59.845103 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:12:59.845103 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:12:59.845103 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:12:59.845103 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:12:59.845103 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:12:59.845103 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:12:59.846159 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:12:59.846159 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:12:59.846159 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:12:59.846159 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:12:59.846159 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:12:59.846159 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:12:59.846159 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:12:59.846159 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:12:59.846159 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:12:59.846159 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:12:59.846159 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:12:59.846159 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:12:59.846159 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:12:59.846159 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:12:59.846159 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:12:59.846159 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:12:59.847153 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:12:59.847153 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:12:59.847153 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:12:59.847153 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:12:59.847153 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:12:59.847153 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:12:59.847153 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:12:59.847153 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:12:59.847153 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:12:59.847153 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:12:59.847153 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:12:59.847153 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:12:59.849684 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 123/237] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 27 20:12:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:12:59.855169 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992084e5-135b-4667-8189-9446c409d9a1 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:12:59.920731 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45d8bb-97c9-4a59-94a9-02a4d4d18c02 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:59.920907 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45d8bb-97c9-4a59-94a9-02a4d4d18c02 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:59.921189 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45d8bb-97c9-4a59-94a9-02a4d4d18c02 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:59.922543 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 124/238] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:12:59.927794 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ceb7a-b7d3-4444-9a7e-4079ffd14f0f None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:12:59.928068 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ceb7a-b7d3-4444-9a7e-4079ffd14f0f None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:12:59.928351 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ceb7a-b7d3-4444-9a7e-4079ffd14f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:12:59.970877 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-8f1ceb7a-b7d3-4444-9a7e-4079ffd14f0f None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:12:59.972561 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-8f1ceb7a-b7d3-4444-9a7e-4079ffd14f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:12:59.991351 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992084e5-135b-4667-8189-9446c409d9a1 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:00.007497 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:00.054976 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50201b-eeee-4e74-b1b8-6a63f47b0bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:00.055648 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50201b-eeee-4e74-b1b8-6a63f47b0bc8 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:00.055924 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50201b-eeee-4e74-b1b8-6a63f47b0bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:00.056193 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50201b-eeee-4e74-b1b8-6a63f47b0bc8 None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:00.056905 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50201b-eeee-4e74-b1b8-6a63f47b0bc8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:00.057205 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50201b-eeee-4e74-b1b8-6a63f47b0bc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:00.059116 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50201b-eeee-4e74-b1b8-6a63f47b0bc8 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:00.077378 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 115/239] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:12:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:00.083666 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50201b-eeee-4e74-b1b8-6a63f47b0bc8 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:00.104894 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 125/240] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:12:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 20:13:00.131941 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ceb7a-b7d3-4444-9a7e-4079ffd14f0f None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:00.262228 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ceb7a-b7d3-4444-9a7e-4079ffd14f0f None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:00.279615 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50201b-eeee-4e74-b1b8-6a63f47b0bc8 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:00.330260 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e078189-f2e7-41b2-b70c-300801ccc335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:00.331315 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e078189-f2e7-41b2-b70c-300801ccc335 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:00.331868 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e078189-f2e7-41b2-b70c-300801ccc335 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:00.332338 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e078189-f2e7-41b2-b70c-300801ccc335 None admin] PATH_INFO: `/v3/users/9e291530f7054a9b9365039a5542ab0d` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:00.333727 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e078189-f2e7-41b2-b70c-300801ccc335 None admin] RBAC: Authorizing `identity:get_user(user_id=9e291530f7054a9b9365039a5542ab0d)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:00.335402 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e078189-f2e7-41b2-b70c-300801ccc335 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:00.337583 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 116/241] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:13:00 2022] GET /identity/v3/users/9e291530f7054a9b9365039a5542ab0d => generated 283 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:00.343026 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e078189-f2e7-41b2-b70c-300801ccc335 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:00.360238 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:00.387749 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:00.405852 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c5c1a-b8f1-4201-86a0-f9736150946e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:00.405852 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c5c1a-b8f1-4201-86a0-f9736150946e None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:00.405852 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c5c1a-b8f1-4201-86a0-f9736150946e None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:00.405852 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c5c1a-b8f1-4201-86a0-f9736150946e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:00.440504 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c5c1a-b8f1-4201-86a0-f9736150946e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:00.445980 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-2a1c5c1a-b8f1-4201-86a0-f9736150946e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 20:13:00.445980 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:00.445980 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:00.445980 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:00.445980 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:00.445980 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:00.445980 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:00.445980 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:00.445980 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:00.445980 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:00.445980 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:00.445980 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:00.445980 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:00.445980 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:00.445980 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:00.445980 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:00.447044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:00.447044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:00.447044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:00.447044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:00.447044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:00.447044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:00.447044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:00.447044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:00.447044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:00.447044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:00.447044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:00.447044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:00.447044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:00.447044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:00.447044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:00.447044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:00.448199 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:00.448199 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:00.448199 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:00.448199 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:00.448199 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:00.448199 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:00.448199 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:00.448199 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:00.448199 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:00.448199 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:00.448199 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 20:13:00.448199 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:00.448199 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 126/242] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 27 20:13:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:13:00.449129 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ae6a8-92da-4dd3-97cd-1009bf3944ef None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:00.449129 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ae6a8-92da-4dd3-97cd-1009bf3944ef None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:00.449129 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ae6a8-92da-4dd3-97cd-1009bf3944ef None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:00.453121 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 127/243] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:00.453121 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bf0e2-de36-45a8-bebf-9a3541e3731d None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:00.453121 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bf0e2-de36-45a8-bebf-9a3541e3731d None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:00.453121 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bf0e2-de36-45a8-bebf-9a3541e3731d None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:00.453121 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 128/244] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:00.453649 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bf0e2-de36-45a8-bebf-9a3541e3731d None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:00.469911 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e078189-f2e7-41b2-b70c-300801ccc335 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:00.504359 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892d183-8b81-4ccc-935d-268e7eb1b120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:00.505299 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892d183-8b81-4ccc-935d-268e7eb1b120 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:00.505725 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892d183-8b81-4ccc-935d-268e7eb1b120 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:00.506228 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892d183-8b81-4ccc-935d-268e7eb1b120 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:00.555861 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bf0e2-de36-45a8-bebf-9a3541e3731d None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:00.578524 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892d183-8b81-4ccc-935d-268e7eb1b120 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:00.580012 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892d183-8b81-4ccc-935d-268e7eb1b120 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:00.593530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4699c-974e-44d7-a79f-cb4544bf2fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:00.594357 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4699c-974e-44d7-a79f-cb4544bf2fd4 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:00.594785 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4699c-974e-44d7-a79f-cb4544bf2fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:00.595091 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4699c-974e-44d7-a79f-cb4544bf2fd4 None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:00.595816 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c4699c-974e-44d7-a79f-cb4544bf2fd4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:00.596125 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c4699c-974e-44d7-a79f-cb4544bf2fd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:00.597498 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c4699c-974e-44d7-a79f-cb4544bf2fd4 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:00.607755 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 129/245] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:13:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:00.608738 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0de283-1477-48ce-bbb7-13e9a7dbfcd1 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:00.609026 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0de283-1477-48ce-bbb7-13e9a7dbfcd1 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:00.609299 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0de283-1477-48ce-bbb7-13e9a7dbfcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:00.625024 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:00.630609 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-df0de283-1477-48ce-bbb7-13e9a7dbfcd1 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:00.631954 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-df0de283-1477-48ce-bbb7-13e9a7dbfcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:00.682413 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:00.699038 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 117/246] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:13:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:00.699038 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a853c-c1f8-4c62-bf44-d5591e5ec27e None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:00.699038 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a853c-c1f8-4c62-bf44-d5591e5ec27e None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:00.699038 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a853c-c1f8-4c62-bf44-d5591e5ec27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:00.709295 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 130/247] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:00.710134 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0de283-1477-48ce-bbb7-13e9a7dbfcd1 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:00.720459 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-ab3a853c-c1f8-4c62-bf44-d5591e5ec27e None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:00.721653 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-ab3a853c-c1f8-4c62-bf44-d5591e5ec27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:00.794075 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 118/248] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:00.800487 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a853c-c1f8-4c62-bf44-d5591e5ec27e None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:00.824574 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0de283-1477-48ce-bbb7-13e9a7dbfcd1 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:00.868053 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ae19f-4b17-4583-875f-118920000ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:00.868692 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ae19f-4b17-4583-875f-118920000ff7 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:00.869181 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ae19f-4b17-4583-875f-118920000ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:00.869290 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ae19f-4b17-4583-875f-118920000ff7 None admin] PATH_INFO: `/v3/users/9e291530f7054a9b9365039a5542ab0d` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:00.870413 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ae19f-4b17-4583-875f-118920000ff7 None admin] RBAC: Authorizing `identity:get_user(user_id=9e291530f7054a9b9365039a5542ab0d)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:00.871872 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ae19f-4b17-4583-875f-118920000ff7 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:00.878412 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 131/249] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:13:00 2022] GET /identity/v3/users/9e291530f7054a9b9365039a5542ab0d => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:00.878412 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ae19f-4b17-4583-875f-118920000ff7 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:00.879718 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:00.920308 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a853c-c1f8-4c62-bf44-d5591e5ec27e None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:00.924188 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:00.959516 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2c38f-f6d5-45c7-8f8f-3be9c0c192bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:00.960171 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2c38f-f6d5-45c7-8f8f-3be9c0c192bf None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:00.960510 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2c38f-f6d5-45c7-8f8f-3be9c0c192bf None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:00.960788 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2c38f-f6d5-45c7-8f8f-3be9c0c192bf None admin] PATH_INFO: `/v3/projects/79b53610ba784f5e9b4c8b6b96c30024` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:00.961891 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2c38f-f6d5-45c7-8f8f-3be9c0c192bf None admin] RBAC: Authorizing `identity:get_project(project_id=79b53610ba784f5e9b4c8b6b96c30024)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:00.966775 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2c38f-f6d5-45c7-8f8f-3be9c0c192bf None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:00.966775 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 119/250] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:13:00 2022] GET /identity/v3/projects/79b53610ba784f5e9b4c8b6b96c30024 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:00.971420 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2c38f-f6d5-45c7-8f8f-3be9c0c192bf None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:00.985666 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ae19f-4b17-4583-875f-118920000ff7 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:01.021431 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fee4a-344f-45f8-b9a9-2c1a376f120e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:01.022298 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fee4a-344f-45f8-b9a9-2c1a376f120e None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:01.022577 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fee4a-344f-45f8-b9a9-2c1a376f120e None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:01.022845 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fee4a-344f-45f8-b9a9-2c1a376f120e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:01.024115 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fee4a-344f-45f8-b9a9-2c1a376f120e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:01.025542 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fee4a-344f-45f8-b9a9-2c1a376f120e None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:01.027853 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 132/251] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:01.028448 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fee4a-344f-45f8-b9a9-2c1a376f120e None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:01.087300 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2c38f-f6d5-45c7-8f8f-3be9c0c192bf None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:01.123137 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b2ec2-d1b5-4b5a-b30a-30997db682a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:01.123880 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b2ec2-d1b5-4b5a-b30a-30997db682a2 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:01.124158 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b2ec2-d1b5-4b5a-b30a-30997db682a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:01.124433 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b2ec2-d1b5-4b5a-b30a-30997db682a2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:01.127424 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:01.135182 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fee4a-344f-45f8-b9a9-2c1a376f120e None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:01.137433 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b2ec2-d1b5-4b5a-b30a-30997db682a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:01.143759 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-847b2ec2-d1b5-4b5a-b30a-30997db682a2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 20:13:01.143759 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:01.143759 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:01.143759 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:01.143759 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:01.143759 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:01.143759 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:01.143759 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:01.143759 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:01.143759 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:01.143759 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:01.143759 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:01.143759 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:01.143759 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:01.143759 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:01.143759 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:01.144846 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:01.144846 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:01.144846 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:01.144846 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:01.144846 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:01.144846 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:01.144846 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:01.144846 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:01.144846 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:01.144846 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:01.144846 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:01.144846 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:01.144846 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:01.144846 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:01.144846 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:01.144846 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:01.145725 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:01.145725 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:01.145725 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:01.145725 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:01.145725 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:01.145725 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:01.145725 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:01.145725 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:01.145725 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:01.145725 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:01.145725 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 20:13:01.145725 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:01.148170 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 120/252] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:01.149118 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b2ec2-d1b5-4b5a-b30a-30997db682a2 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:01.157538 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:01.177025 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30c7d1-7701-45dc-b959-e272a7ae15c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:01.177791 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30c7d1-7701-45dc-b959-e272a7ae15c7 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:01.178074 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30c7d1-7701-45dc-b959-e272a7ae15c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:01.178351 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30c7d1-7701-45dc-b959-e272a7ae15c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:01.248325 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30c7d1-7701-45dc-b959-e272a7ae15c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:01.249791 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30c7d1-7701-45dc-b959-e272a7ae15c7 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:01.251526 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b2ec2-d1b5-4b5a-b30a-30997db682a2 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:01.284390 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ca29c-f769-451f-b0eb-05d81b8b8856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:01.285000 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ca29c-f769-451f-b0eb-05d81b8b8856 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:01.285274 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ca29c-f769-451f-b0eb-05d81b8b8856 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:01.285543 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ca29c-f769-451f-b0eb-05d81b8b8856 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:01.286311 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ca29c-f769-451f-b0eb-05d81b8b8856 None admin] RBAC: Adding query filter params (role.id=df8ec36d044b469d8854eba8394eb107, scope.project.id=79b53610ba784f5e9b4c8b6b96c30024, user.id=9e291530f7054a9b9365039a5542ab0d) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:01.286614 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ca29c-f769-451f-b0eb-05d81b8b8856 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:01.288052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ca29c-f769-451f-b0eb-05d81b8b8856 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:01.293669 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 121/253] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:13:01 2022] GET /identity/v3/role_assignments?user.id=9e291530f7054a9b9365039a5542ab0d&scope.project.id=79b53610ba784f5e9b4c8b6b96c30024&role.id=df8ec36d044b469d8854eba8394eb107 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:01.294420 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ca29c-f769-451f-b0eb-05d81b8b8856 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:01.362213 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 133/254] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:13:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:01.362824 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:01.362930 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30c7d1-7701-45dc-b959-e272a7ae15c7 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:01.383746 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:01.417422 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ca29c-f769-451f-b0eb-05d81b8b8856 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:01.456525 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3457875-59ff-477a-af9e-e080871201ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:01.457155 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3457875-59ff-477a-af9e-e080871201ef None admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:01.457439 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3457875-59ff-477a-af9e-e080871201ef None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:01.457712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3457875-59ff-477a-af9e-e080871201ef None admin] PATH_INFO: `/v3/users` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:01.458413 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3457875-59ff-477a-af9e-e080871201ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:01.459907 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3457875-59ff-477a-af9e-e080871201ef None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:01.476184 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30c7d1-7701-45dc-b959-e272a7ae15c7 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:01.484453 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 122/255] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 27 20:13:01 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:13:01.485780 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4611b-c008-47c8-af4f-a77ad828830f None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:01.486070 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4611b-c008-47c8-af4f-a77ad828830f None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:01.486342 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4611b-c008-47c8-af4f-a77ad828830f None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:01.487799 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 123/256] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:01.488358 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4611b-c008-47c8-af4f-a77ad828830f None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:01.526606 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5c72d-42ce-456b-91c4-d351bf2e68d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:01.527282 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5c72d-42ce-456b-91c4-d351bf2e68d5 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:01.527577 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5c72d-42ce-456b-91c4-d351bf2e68d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:01.528079 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5c72d-42ce-456b-91c4-d351bf2e68d5 None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:01.528562 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5c72d-42ce-456b-91c4-d351bf2e68d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:01.528871 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5c72d-42ce-456b-91c4-d351bf2e68d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:01.530334 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5c72d-42ce-456b-91c4-d351bf2e68d5 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:01.540906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 134/257] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:13:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:01.544383 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a271b3-18bb-41d6-afdf-bb5e53564074 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:01.544668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a271b3-18bb-41d6-afdf-bb5e53564074 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:01.544939 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a271b3-18bb-41d6-afdf-bb5e53564074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:01.567608 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-86a271b3-18bb-41d6-afdf-bb5e53564074 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:01.569724 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-86a271b3-18bb-41d6-afdf-bb5e53564074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:01.620966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4611b-c008-47c8-af4f-a77ad828830f None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:01.642060 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:01.657828 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 135/258] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:01.658799 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a271b3-18bb-41d6-afdf-bb5e53564074 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:01.666159 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405c5f8-6f95-4f63-bd8a-2de2c740cd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:01.666938 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405c5f8-6f95-4f63-bd8a-2de2c740cd52 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:01.667308 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405c5f8-6f95-4f63-bd8a-2de2c740cd52 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:01.667646 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405c5f8-6f95-4f63-bd8a-2de2c740cd52 None admin] PATH_INFO: `/v3/projects/79b53610ba784f5e9b4c8b6b96c30024` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:01.669825 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405c5f8-6f95-4f63-bd8a-2de2c740cd52 None admin] RBAC: Authorizing `identity:get_project(project_id=79b53610ba784f5e9b4c8b6b96c30024)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:01.672359 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405c5f8-6f95-4f63-bd8a-2de2c740cd52 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:01.674313 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 124/259] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:13:01 2022] GET /identity/v3/projects/79b53610ba784f5e9b4c8b6b96c30024 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:01.680108 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405c5f8-6f95-4f63-bd8a-2de2c740cd52 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:01.681601 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:01.787320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a271b3-18bb-41d6-afdf-bb5e53564074 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:01.808284 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405c5f8-6f95-4f63-bd8a-2de2c740cd52 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:01.832344 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10662e70-aadd-46b9-86b0-decc2f360a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:01.833000 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10662e70-aadd-46b9-86b0-decc2f360a4d None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:01.833276 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10662e70-aadd-46b9-86b0-decc2f360a4d None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:01.833544 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10662e70-aadd-46b9-86b0-decc2f360a4d None admin] PATH_INFO: `/v3/users/70f6e5542fb443bda3ffc0e8d8be9411` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:01.846733 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df135103-9eea-41e5-b859-5e0f27f27072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:01.848532 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df135103-9eea-41e5-b859-5e0f27f27072 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:01.848532 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df135103-9eea-41e5-b859-5e0f27f27072 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:01.848532 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df135103-9eea-41e5-b859-5e0f27f27072 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:01.848751 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df135103-9eea-41e5-b859-5e0f27f27072 None admin] RBAC: Adding query filter params (role.id=b63f862c45f24bd8856021d73b8fa0e2, scope.project.id=79b53610ba784f5e9b4c8b6b96c30024, user.id=9e291530f7054a9b9365039a5542ab0d) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:01.849037 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df135103-9eea-41e5-b859-5e0f27f27072 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:01.850444 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df135103-9eea-41e5-b859-5e0f27f27072 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:01.853692 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10662e70-aadd-46b9-86b0-decc2f360a4d None admin] RBAC: Authorizing `identity:get_user(user_id=70f6e5542fb443bda3ffc0e8d8be9411)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:01.855758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10662e70-aadd-46b9-86b0-decc2f360a4d None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:01.857633 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 136/260] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:13:01 2022] GET /identity/v3/users/70f6e5542fb443bda3ffc0e8d8be9411 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:01.862312 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10662e70-aadd-46b9-86b0-decc2f360a4d None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:01.862453 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 125/261] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:13:01 2022] GET /identity/v3/role_assignments?user.id=9e291530f7054a9b9365039a5542ab0d&scope.project.id=79b53610ba784f5e9b4c8b6b96c30024&role.id=b63f862c45f24bd8856021d73b8fa0e2 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:01.863361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df135103-9eea-41e5-b859-5e0f27f27072 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:01.929884 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:01.951230 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:02.014321 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10662e70-aadd-46b9-86b0-decc2f360a4d None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:02.052058 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df135103-9eea-41e5-b859-5e0f27f27072 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:02.053357 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f459e-7419-4742-80b1-0eff38d46055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:02.054040 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f459e-7419-4742-80b1-0eff38d46055 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:02.054324 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f459e-7419-4742-80b1-0eff38d46055 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:02.054600 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f459e-7419-4742-80b1-0eff38d46055 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:02.067532 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f459e-7419-4742-80b1-0eff38d46055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:02.075111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-3d9f459e-7419-4742-80b1-0eff38d46055 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:13:02.075111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:02.075111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:02.075111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:02.075111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:02.075111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:02.075111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:02.075111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:02.075111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:02.075111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:02.075111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:02.075111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:02.075111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:02.075111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:02.075111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:02.075111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:02.076053 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:02.076053 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:02.076053 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:02.076053 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:02.076053 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:02.076053 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:02.076053 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:02.076053 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:02.076053 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:02.076053 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:02.076053 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:02.076053 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:02.076053 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:02.076053 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:02.076053 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:02.076053 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:02.076843 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:02.076843 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:02.076843 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:02.076843 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:02.076843 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:02.076843 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:02.076843 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:02.076843 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:02.076843 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:02.076843 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:02.076843 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:13:02.076843 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:02.076843 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 137/262] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:02.080507 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f459e-7419-4742-80b1-0eff38d46055 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:02.126674 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71adc6b-d3dd-4b14-aa09-7d8e4ce58851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:02.127592 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71adc6b-d3dd-4b14-aa09-7d8e4ce58851 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:02.128550 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71adc6b-d3dd-4b14-aa09-7d8e4ce58851 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:02.128837 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71adc6b-d3dd-4b14-aa09-7d8e4ce58851 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:02.230809 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71adc6b-d3dd-4b14-aa09-7d8e4ce58851 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:02.233243 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71adc6b-d3dd-4b14-aa09-7d8e4ce58851 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:02.236831 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f459e-7419-4742-80b1-0eff38d46055 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:02.276539 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:02.288462 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0384a-b2fc-4e30-9cb7-c24d9488bf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:02.289090 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0384a-b2fc-4e30-9cb7-c24d9488bf41 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:02.289372 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0384a-b2fc-4e30-9cb7-c24d9488bf41 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:02.289646 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0384a-b2fc-4e30-9cb7-c24d9488bf41 None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:02.290372 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0384a-b2fc-4e30-9cb7-c24d9488bf41 None admin] RBAC: Adding query filter params (name=member) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:02.290681 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0384a-b2fc-4e30-9cb7-c24d9488bf41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:02.293901 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0384a-b2fc-4e30-9cb7-c24d9488bf41 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:02.308004 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 138/263] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:13:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:02.314372 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0384a-b2fc-4e30-9cb7-c24d9488bf41 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:02.319418 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:02.379018 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 126/264] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:13:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:02.380358 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71adc6b-d3dd-4b14-aa09-7d8e4ce58851 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:02.433761 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0384a-b2fc-4e30-9cb7-c24d9488bf41 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:02.471054 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82e24d-8691-4e6b-8ed7-9899d9dccced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:02.471758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82e24d-8691-4e6b-8ed7-9899d9dccced None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:02.472039 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82e24d-8691-4e6b-8ed7-9899d9dccced None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:02.472314 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82e24d-8691-4e6b-8ed7-9899d9dccced None admin] PATH_INFO: `/v3/users/95a1234a62ea4fab82fc866858fbe371` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:02.473609 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f82e24d-8691-4e6b-8ed7-9899d9dccced None admin] RBAC: Authorizing `identity:get_user(user_id=95a1234a62ea4fab82fc866858fbe371)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:02.475218 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f82e24d-8691-4e6b-8ed7-9899d9dccced None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:02.481771 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 139/265] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:13:02 2022] GET /identity/v3/users/95a1234a62ea4fab82fc866858fbe371 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:02.482497 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82e24d-8691-4e6b-8ed7-9899d9dccced None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:02.488052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71adc6b-d3dd-4b14-aa09-7d8e4ce58851 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:02.524786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efa4af-7afc-41e1-8f7a-d40b2a9c1b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:02.525809 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efa4af-7afc-41e1-8f7a-d40b2a9c1b06 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:02.526844 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efa4af-7afc-41e1-8f7a-d40b2a9c1b06 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:02.527353 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efa4af-7afc-41e1-8f7a-d40b2a9c1b06 None admin] PATH_INFO: `/v3/projects/79b53610ba784f5e9b4c8b6b96c30024` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:02.528744 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65efa4af-7afc-41e1-8f7a-d40b2a9c1b06 None admin] RBAC: Authorizing `identity:get_project(project_id=79b53610ba784f5e9b4c8b6b96c30024)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:02.530393 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65efa4af-7afc-41e1-8f7a-d40b2a9c1b06 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:02.532321 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 127/266] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:13:02 2022] GET /identity/v3/projects/79b53610ba784f5e9b4c8b6b96c30024 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:02.538305 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efa4af-7afc-41e1-8f7a-d40b2a9c1b06 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:02.545169 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:02.559171 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:02.596393 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82e24d-8691-4e6b-8ed7-9899d9dccced None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:02.631045 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36664cec-4cd7-4047-809a-9fcfaa494d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:02.631737 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36664cec-4cd7-4047-809a-9fcfaa494d7a None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:02.632018 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36664cec-4cd7-4047-809a-9fcfaa494d7a None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:02.632291 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36664cec-4cd7-4047-809a-9fcfaa494d7a None admin] PATH_INFO: `/v3/projects/79b53610ba784f5e9b4c8b6b96c30024` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:02.633578 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36664cec-4cd7-4047-809a-9fcfaa494d7a None admin] RBAC: Authorizing `identity:get_project(project_id=79b53610ba784f5e9b4c8b6b96c30024)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:02.634892 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36664cec-4cd7-4047-809a-9fcfaa494d7a None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:02.637480 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 140/267] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:13:02 2022] GET /identity/v3/projects/79b53610ba784f5e9b4c8b6b96c30024 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:02.642767 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36664cec-4cd7-4047-809a-9fcfaa494d7a None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:02.653713 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efa4af-7afc-41e1-8f7a-d40b2a9c1b06 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:02.697054 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7130e9-cd42-45df-9d76-372c450f17e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:02.698715 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7130e9-cd42-45df-9d76-372c450f17e6 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:02.699429 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7130e9-cd42-45df-9d76-372c450f17e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:02.699906 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7130e9-cd42-45df-9d76-372c450f17e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:02.701450 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7130e9-cd42-45df-9d76-372c450f17e6 None admin] RBAC: Adding query filter params (role.id=b166adb7927b4a9fbd2ade12fa51de68, scope.project.id=79b53610ba784f5e9b4c8b6b96c30024, user.id=70f6e5542fb443bda3ffc0e8d8be9411) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:02.701985 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7130e9-cd42-45df-9d76-372c450f17e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:02.703974 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7130e9-cd42-45df-9d76-372c450f17e6 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:02.711126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 128/268] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:13:02 2022] GET /identity/v3/role_assignments?user.id=70f6e5542fb443bda3ffc0e8d8be9411&scope.project.id=79b53610ba784f5e9b4c8b6b96c30024&role.id=b166adb7927b4a9fbd2ade12fa51de68 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:02.759893 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36664cec-4cd7-4047-809a-9fcfaa494d7a None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:02.787416 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:02.801647 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5ea9e-8096-4387-9524-3c0794b897d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:02.802576 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5ea9e-8096-4387-9524-3c0794b897d4 None admin] REQUEST_METHOD: `PUT` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:02.803039 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5ea9e-8096-4387-9524-3c0794b897d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:02.803776 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5ea9e-8096-4387-9524-3c0794b897d4 None admin] PATH_INFO: `/v3/projects/79b53610ba784f5e9b4c8b6b96c30024/users/95a1234a62ea4fab82fc866858fbe371/roles/13a38ce5696549bf95272ffae43798c8` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:02.806026 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5ea9e-8096-4387-9524-3c0794b897d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=79b53610ba784f5e9b4c8b6b96c30024, user_id=95a1234a62ea4fab82fc866858fbe371, role_id=13a38ce5696549bf95272ffae43798c8)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:02.808587 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5ea9e-8096-4387-9524-3c0794b897d4 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:02.829482 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 141/269] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 27 20:13:02 2022] PUT /identity/v3/projects/79b53610ba784f5e9b4c8b6b96c30024/users/95a1234a62ea4fab82fc866858fbe371/roles/13a38ce5696549bf95272ffae43798c8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 20:13:04.019758 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26801f-0c1a-4c9b-8616-677bd8e43af7 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:04.020271 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26801f-0c1a-4c9b-8616-677bd8e43af7 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:04.020345 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26801f-0c1a-4c9b-8616-677bd8e43af7 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:04.021912 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 129/270] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:04.027983 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a0be0-8ebb-44c4-a8d9-e14a9058908d None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:04.028389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a0be0-8ebb-44c4-a8d9-e14a9058908d None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:04.028574 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a0be0-8ebb-44c4-a8d9-e14a9058908d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:04.039706 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd432d-f090-473e-8c57-88c9e9504140 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:04.040299 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd432d-f090-473e-8c57-88c9e9504140 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:04.040812 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd432d-f090-473e-8c57-88c9e9504140 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:04.042513 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 130/271] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:04.047743 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afaa63-769f-4531-be3b-25e3e2e4dd63 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:04.048313 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afaa63-769f-4531-be3b-25e3e2e4dd63 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:04.048598 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-7d1a0be0-8ebb-44c4-a8d9-e14a9058908d None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:04.049031 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afaa63-769f-4531-be3b-25e3e2e4dd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:04.049796 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-7d1a0be0-8ebb-44c4-a8d9-e14a9058908d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:04.067305 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-64afaa63-769f-4531-be3b-25e3e2e4dd63 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:04.068800 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-64afaa63-769f-4531-be3b-25e3e2e4dd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:04.123747 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 142/272] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 20:13:04.152431 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 131/273] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 20:13:04.156153 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a0be0-8ebb-44c4-a8d9-e14a9058908d None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:04.177956 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afaa63-769f-4531-be3b-25e3e2e4dd63 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:04.189808 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:04.272965 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a0be0-8ebb-44c4-a8d9-e14a9058908d None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:04.289308 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:04.303043 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afaa63-769f-4531-be3b-25e3e2e4dd63 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:04.319060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1929e-4a5d-4df7-b4a1-d4cdbf2a6ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:04.320150 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1929e-4a5d-4df7-b4a1-d4cdbf2a6ee8 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:04.320659 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1929e-4a5d-4df7-b4a1-d4cdbf2a6ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:04.321340 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1929e-4a5d-4df7-b4a1-d4cdbf2a6ee8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:04.336806 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1929e-4a5d-4df7-b4a1-d4cdbf2a6ee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:04.343305 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-57f1929e-4a5d-4df7-b4a1-d4cdbf2a6ee8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:13:04.343305 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:04.343305 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:04.343305 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:04.343305 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:04.343305 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:04.343305 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:04.343305 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:04.343305 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:04.343305 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:04.343305 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:04.343305 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:04.343305 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:04.343305 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:04.343305 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:04.343305 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:04.344258 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:04.344258 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:04.344258 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:04.344258 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:04.344258 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:04.344258 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:04.344258 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:04.344258 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:04.344258 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:04.344258 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:04.344258 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:04.344258 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:04.344258 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:04.344258 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:04.344258 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:04.344258 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:04.345039 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:04.345039 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:04.345039 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:04.345039 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:04.345039 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:04.345039 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:04.345039 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:04.345039 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:04.345039 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:04.345039 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:04.345039 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:13:04.345039 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:04.345679 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81fc9c-787a-4965-af2f-2a15c1095dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:04.345679 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81fc9c-787a-4965-af2f-2a15c1095dc2 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:04.345679 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81fc9c-787a-4965-af2f-2a15c1095dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:04.345885 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 143/274] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:04.349871 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81fc9c-787a-4965-af2f-2a15c1095dc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:04.351238 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81fc9c-787a-4965-af2f-2a15c1095dc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:04.351785 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1929e-4a5d-4df7-b4a1-d4cdbf2a6ee8 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:04.352773 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81fc9c-787a-4965-af2f-2a15c1095dc2 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:04.354429 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 132/275] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:04.361026 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81fc9c-787a-4965-af2f-2a15c1095dc2 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:04.455162 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:04.468725 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1929e-4a5d-4df7-b4a1-d4cdbf2a6ee8 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:04.481185 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81fc9c-787a-4965-af2f-2a15c1095dc2 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:04.504944 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739572b-6838-463a-beaa-086deac7adfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:04.505562 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739572b-6838-463a-beaa-086deac7adfe None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:04.505838 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739572b-6838-463a-beaa-086deac7adfe None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:04.506106 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739572b-6838-463a-beaa-086deac7adfe None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:04.506861 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739572b-6838-463a-beaa-086deac7adfe None admin] RBAC: Adding query filter params (name=member) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:04.507182 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739572b-6838-463a-beaa-086deac7adfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:04.508623 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739572b-6838-463a-beaa-086deac7adfe None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:04.521431 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bb0c8-38c3-4da5-9d96-076754c71ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:04.522412 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bb0c8-38c3-4da5-9d96-076754c71ce3 None admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:04.522518 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 144/276] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:13:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:04.523056 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bb0c8-38c3-4da5-9d96-076754c71ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:04.523562 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bb0c8-38c3-4da5-9d96-076754c71ce3 None admin] PATH_INFO: `/v3/users` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:04.523803 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739572b-6838-463a-beaa-086deac7adfe None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:04.524765 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bb0c8-38c3-4da5-9d96-076754c71ce3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:04.526592 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bb0c8-38c3-4da5-9d96-076754c71ce3 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:04.552914 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 133/277] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 27 20:13:04 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 20:13:04.570529 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:04.652654 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739572b-6838-463a-beaa-086deac7adfe None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:04.692817 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ceaff8-6546-4fbb-9fc9-192d210135fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:04.693857 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ceaff8-6546-4fbb-9fc9-192d210135fb None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:04.694329 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ceaff8-6546-4fbb-9fc9-192d210135fb None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:04.694793 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ceaff8-6546-4fbb-9fc9-192d210135fb None admin] PATH_INFO: `/v3/users/c62b350acd15482fb3b9fdbf34856009` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:04.711819 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ceaff8-6546-4fbb-9fc9-192d210135fb None admin] RBAC: Authorizing `identity:get_user(user_id=c62b350acd15482fb3b9fdbf34856009)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:04.713910 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ceaff8-6546-4fbb-9fc9-192d210135fb None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:04.716341 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 145/278] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:13:04 2022] GET /identity/v3/users/c62b350acd15482fb3b9fdbf34856009 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:04.725083 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bb0c8-38c3-4da5-9d96-076754c71ce3 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:04.835602 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bb0c8-38c3-4da5-9d96-076754c71ce3 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:04.870891 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b838a2-97ed-4c63-abaf-ef24fe53b888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:04.871541 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b838a2-97ed-4c63-abaf-ef24fe53b888 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:04.871820 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b838a2-97ed-4c63-abaf-ef24fe53b888 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:04.872087 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b838a2-97ed-4c63-abaf-ef24fe53b888 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:04.872878 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b838a2-97ed-4c63-abaf-ef24fe53b888 None admin] RBAC: Adding query filter params (role.id=13a38ce5696549bf95272ffae43798c8, user.id=c62b350acd15482fb3b9fdbf34856009, scope.system=all) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:04.873198 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b838a2-97ed-4c63-abaf-ef24fe53b888 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:04.874646 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b838a2-97ed-4c63-abaf-ef24fe53b888 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:04.876383 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:04.885267 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 134/279] 10.222.0.83 () {56 vars in 1308 bytes} [Wed Jul 27 20:13:04 2022] GET /identity/v3/role_assignments?user.id=c62b350acd15482fb3b9fdbf34856009&scope.system=all&role.id=13a38ce5696549bf95272ffae43798c8 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:05.066891 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806757b-7b71-46c6-924f-4760484d2f2c None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:05.067760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806757b-7b71-46c6-924f-4760484d2f2c None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:05.068181 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806757b-7b71-46c6-924f-4760484d2f2c None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:05.069825 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 146/280] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:05.075790 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9302b0-14ce-4aa7-acf9-db77c7c2eb01 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:05.076297 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9302b0-14ce-4aa7-acf9-db77c7c2eb01 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:05.076383 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9302b0-14ce-4aa7-acf9-db77c7c2eb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:05.097777 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-9d9302b0-14ce-4aa7-acf9-db77c7c2eb01 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:05.098906 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-9d9302b0-14ce-4aa7-acf9-db77c7c2eb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:05.184730 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 135/281] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:05.185501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5fb31-47ba-453e-9d0a-217e985b1fb5 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:05.185796 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5fb31-47ba-453e-9d0a-217e985b1fb5 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:05.186077 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5fb31-47ba-453e-9d0a-217e985b1fb5 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:05.187676 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 147/282] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:05.204613 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab093d-e241-496c-94ee-0eb5028b50c9 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:05.204902 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab093d-e241-496c-94ee-0eb5028b50c9 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:05.205178 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab093d-e241-496c-94ee-0eb5028b50c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:05.215333 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5fb31-47ba-453e-9d0a-217e985b1fb5 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:05.226643 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-bbab093d-e241-496c-94ee-0eb5028b50c9 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:05.227872 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-bbab093d-e241-496c-94ee-0eb5028b50c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:05.307981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 136/283] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:05.337619 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab093d-e241-496c-94ee-0eb5028b50c9 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:05.420721 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:05.435997 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5fb31-47ba-453e-9d0a-217e985b1fb5 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:05.459452 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:05.508004 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4396b-0e36-4703-a5c2-9e19da030304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:05.508650 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4396b-0e36-4703-a5c2-9e19da030304 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:05.508929 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4396b-0e36-4703-a5c2-9e19da030304 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:05.509197 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4396b-0e36-4703-a5c2-9e19da030304 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:05.515065 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab093d-e241-496c-94ee-0eb5028b50c9 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:05.530887 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4396b-0e36-4703-a5c2-9e19da030304 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:05.536013 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-7cd4396b-0e36-4703-a5c2-9e19da030304 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 20:13:05.536013 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:05.536013 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:05.536013 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:05.536013 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:05.536013 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:05.536013 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:05.536013 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:05.536013 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:05.536013 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:05.536013 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:05.536013 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:05.536013 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:05.536013 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:05.536013 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:05.536013 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:05.536908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:05.536908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:05.536908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:05.536908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:05.536908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:05.536908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:05.536908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:05.536908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:05.536908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:05.536908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:05.536908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:05.536908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:05.536908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:05.536908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:05.536908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:05.536908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:05.537693 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:05.537693 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:05.537693 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:05.537693 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:05.537693 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:05.537693 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:05.537693 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:05.537693 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:05.537693 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:05.537693 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:05.537693 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 20:13:05.537693 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:05.538289 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 148/284] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:05.542834 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4396b-0e36-4703-a5c2-9e19da030304 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:05.593979 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa80322-9039-4ee8-a182-664056679172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:05.594629 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa80322-9039-4ee8-a182-664056679172 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:05.594908 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa80322-9039-4ee8-a182-664056679172 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:05.595206 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa80322-9039-4ee8-a182-664056679172 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:05.619627 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa80322-9039-4ee8-a182-664056679172 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:05.626154 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-caa80322-9039-4ee8-a182-664056679172 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:13:05.626154 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:05.626154 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:05.626154 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:05.626154 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:05.626154 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:05.626154 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:05.626154 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:05.626154 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:05.626154 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:05.626154 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:05.626154 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:05.626154 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:05.626154 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:05.626154 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:05.626154 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:05.627035 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:05.627035 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:05.627035 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:05.627035 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:05.627035 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:05.627035 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:05.627035 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:05.627035 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:05.627035 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:05.627035 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:05.627035 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:05.627035 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:05.627035 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:05.627035 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:05.627035 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:05.627035 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:05.628125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:05.628125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:05.628125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:05.628125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:05.628125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:05.628125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:05.628125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:05.628125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:05.628125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:05.628125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:05.628125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:13:05.628125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:05.630485 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 137/285] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:05.635039 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa80322-9039-4ee8-a182-664056679172 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:05.699433 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4396b-0e36-4703-a5c2-9e19da030304 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:05.735156 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f47475-964a-475b-963b-92e98ba6fc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:05.735781 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f47475-964a-475b-963b-92e98ba6fc66 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:05.736059 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f47475-964a-475b-963b-92e98ba6fc66 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:05.736442 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f47475-964a-475b-963b-92e98ba6fc66 None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:05.737157 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f47475-964a-475b-963b-92e98ba6fc66 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:05.737459 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f47475-964a-475b-963b-92e98ba6fc66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:05.738845 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f47475-964a-475b-963b-92e98ba6fc66 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:05.747844 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 149/286] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:13:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:05.753327 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f47475-964a-475b-963b-92e98ba6fc66 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:05.791498 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:05.858911 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa80322-9039-4ee8-a182-664056679172 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:05.896333 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:05.928158 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a5de1-1ea0-49a2-ad05-013857d1ba95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:05.928782 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a5de1-1ea0-49a2-ad05-013857d1ba95 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:05.931463 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a5de1-1ea0-49a2-ad05-013857d1ba95 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:05.931768 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a5de1-1ea0-49a2-ad05-013857d1ba95 None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:05.933007 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a5de1-1ea0-49a2-ad05-013857d1ba95 None admin] RBAC: Adding query filter params (name=member) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:05.935107 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a5de1-1ea0-49a2-ad05-013857d1ba95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:05.937258 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a5de1-1ea0-49a2-ad05-013857d1ba95 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:05.943257 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f47475-964a-475b-963b-92e98ba6fc66 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:05.957522 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 138/287] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:13:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:05.963263 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a5de1-1ea0-49a2-ad05-013857d1ba95 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:06.011766 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be31e8-ee86-4433-90ef-fc3542e12eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:06.012429 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be31e8-ee86-4433-90ef-fc3542e12eb8 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:06.014147 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be31e8-ee86-4433-90ef-fc3542e12eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:06.014458 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be31e8-ee86-4433-90ef-fc3542e12eb8 None admin] PATH_INFO: `/v3/users/70f6e5542fb443bda3ffc0e8d8be9411` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:06.016489 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be31e8-ee86-4433-90ef-fc3542e12eb8 None admin] RBAC: Authorizing `identity:get_user(user_id=70f6e5542fb443bda3ffc0e8d8be9411)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:06.018853 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be31e8-ee86-4433-90ef-fc3542e12eb8 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:06.020629 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 150/288] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:13:05 2022] GET /identity/v3/users/70f6e5542fb443bda3ffc0e8d8be9411 => generated 297 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:06.027966 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be31e8-ee86-4433-90ef-fc3542e12eb8 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:06.162101 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a5de1-1ea0-49a2-ad05-013857d1ba95 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:06.206344 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:06.235766 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6a50f-150a-4477-a89a-5e180f6553dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:06.236432 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6a50f-150a-4477-a89a-5e180f6553dc None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:06.236712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6a50f-150a-4477-a89a-5e180f6553dc None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:06.236983 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6a50f-150a-4477-a89a-5e180f6553dc None admin] PATH_INFO: `/v3/users/95a1234a62ea4fab82fc866858fbe371` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:06.239691 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be31e8-ee86-4433-90ef-fc3542e12eb8 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:06.242180 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6a50f-150a-4477-a89a-5e180f6553dc None admin] RBAC: Authorizing `identity:get_user(user_id=95a1234a62ea4fab82fc866858fbe371)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:06.243689 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6a50f-150a-4477-a89a-5e180f6553dc None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:06.253857 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 139/289] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:13:05 2022] GET /identity/v3/users/95a1234a62ea4fab82fc866858fbe371 => generated 297 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:06.254735 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6a50f-150a-4477-a89a-5e180f6553dc None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:06.320678 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:06.323461 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ac4d5-64f7-4068-aaf1-8e415f66fc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:06.324116 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ac4d5-64f7-4068-aaf1-8e415f66fc09 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:06.324548 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ac4d5-64f7-4068-aaf1-8e415f66fc09 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:06.324836 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ac4d5-64f7-4068-aaf1-8e415f66fc09 None admin] PATH_INFO: `/v3/projects/79b53610ba784f5e9b4c8b6b96c30024` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:06.326130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ac4d5-64f7-4068-aaf1-8e415f66fc09 None admin] RBAC: Authorizing `identity:get_project(project_id=79b53610ba784f5e9b4c8b6b96c30024)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:06.327630 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ac4d5-64f7-4068-aaf1-8e415f66fc09 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:06.330746 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 151/290] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:13:06 2022] GET /identity/v3/projects/79b53610ba784f5e9b4c8b6b96c30024 => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:06.338454 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ac4d5-64f7-4068-aaf1-8e415f66fc09 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:06.472573 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ac4d5-64f7-4068-aaf1-8e415f66fc09 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:06.472957 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6a50f-150a-4477-a89a-5e180f6553dc None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:06.511342 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cd003-3f49-41a3-8721-f371e0767604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:06.512217 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cd003-3f49-41a3-8721-f371e0767604 None admin] REQUEST_METHOD: `PUT` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:06.512512 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cd003-3f49-41a3-8721-f371e0767604 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:06.512793 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cd003-3f49-41a3-8721-f371e0767604 None admin] PATH_INFO: `/v3/projects/79b53610ba784f5e9b4c8b6b96c30024/users/70f6e5542fb443bda3ffc0e8d8be9411/roles/b166adb7927b4a9fbd2ade12fa51de68` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:06.514944 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cd003-3f49-41a3-8721-f371e0767604 None admin] RBAC: Authorizing `identity:create_grant(project_id=79b53610ba784f5e9b4c8b6b96c30024, user_id=70f6e5542fb443bda3ffc0e8d8be9411, role_id=b166adb7927b4a9fbd2ade12fa51de68)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:06.516435 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cd003-3f49-41a3-8721-f371e0767604 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:06.534036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 152/291] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 27 20:13:06 2022] PUT /identity/v3/projects/79b53610ba784f5e9b4c8b6b96c30024/users/70f6e5542fb443bda3ffc0e8d8be9411/roles/b166adb7927b4a9fbd2ade12fa51de68 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:13:06.560851 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f0bd7-d752-4e3f-8977-82cff517015a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:06.561511 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f0bd7-d752-4e3f-8977-82cff517015a None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:06.561804 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f0bd7-d752-4e3f-8977-82cff517015a None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:06.562054 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f0bd7-d752-4e3f-8977-82cff517015a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:06.684743 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f0bd7-d752-4e3f-8977-82cff517015a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:06.686230 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f0bd7-d752-4e3f-8977-82cff517015a None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:06.777067 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:06.832511 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 140/292] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:13:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:06.838623 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cd003-3f49-41a3-8721-f371e0767604 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:06.861795 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:06.972284 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cd003-3f49-41a3-8721-f371e0767604 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:07.007248 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ccf37-6be3-496c-aeb0-a30dbc4e6770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:07.008299 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ccf37-6be3-496c-aeb0-a30dbc4e6770 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:07.008788 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ccf37-6be3-496c-aeb0-a30dbc4e6770 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:07.009278 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ccf37-6be3-496c-aeb0-a30dbc4e6770 None admin] PATH_INFO: `/v3/projects/79b53610ba784f5e9b4c8b6b96c30024` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:07.011213 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ccf37-6be3-496c-aeb0-a30dbc4e6770 None admin] RBAC: Authorizing `identity:get_project(project_id=79b53610ba784f5e9b4c8b6b96c30024)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:07.012880 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ccf37-6be3-496c-aeb0-a30dbc4e6770 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:07.014760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 153/293] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:13:06 2022] GET /identity/v3/projects/79b53610ba784f5e9b4c8b6b96c30024 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:07.020824 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f0bd7-d752-4e3f-8977-82cff517015a None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:07.159595 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f0bd7-d752-4e3f-8977-82cff517015a None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:07.196125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c795901-d7a0-4024-a75e-117f1e0587c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:07.196781 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c795901-d7a0-4024-a75e-117f1e0587c1 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:07.197015 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c795901-d7a0-4024-a75e-117f1e0587c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:07.197956 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c795901-d7a0-4024-a75e-117f1e0587c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:07.198905 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c795901-d7a0-4024-a75e-117f1e0587c1 None admin] RBAC: Adding query filter params (role.id=13a38ce5696549bf95272ffae43798c8, scope.project.id=79b53610ba784f5e9b4c8b6b96c30024, user.id=95a1234a62ea4fab82fc866858fbe371) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:07.199387 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c795901-d7a0-4024-a75e-117f1e0587c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:07.200984 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c795901-d7a0-4024-a75e-117f1e0587c1 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:07.207792 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 141/294] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:13:07 2022] GET /identity/v3/role_assignments?user.id=95a1234a62ea4fab82fc866858fbe371&scope.project.id=79b53610ba784f5e9b4c8b6b96c30024&role.id=13a38ce5696549bf95272ffae43798c8 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:07.412006 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d9d98-dbcb-4d6c-a5c7-00fd96d32b02 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:07.413001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d9d98-dbcb-4d6c-a5c7-00fd96d32b02 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:07.413493 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d9d98-dbcb-4d6c-a5c7-00fd96d32b02 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:07.415239 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 154/295] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:07.421253 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dba419-a16e-4967-8b70-ca75178510b8 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:07.421835 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dba419-a16e-4967-8b70-ca75178510b8 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:07.422303 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dba419-a16e-4967-8b70-ca75178510b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:07.442765 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-16dba419-a16e-4967-8b70-ca75178510b8 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:07.444407 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-16dba419-a16e-4967-8b70-ca75178510b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:07.464705 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:07.539097 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 142/296] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:07.550653 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffae29-70b7-415c-bf51-254fb2191829 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:07.550939 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffae29-70b7-415c-bf51-254fb2191829 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:07.551253 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffae29-70b7-415c-bf51-254fb2191829 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:07.553815 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 155/297] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:07.558634 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b37ef-50b4-4b6a-a7a1-7cd7347b2a39 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:07.558920 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b37ef-50b4-4b6a-a7a1-7cd7347b2a39 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:07.559260 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b37ef-50b4-4b6a-a7a1-7cd7347b2a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:07.563311 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffae29-70b7-415c-bf51-254fb2191829 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:07.587834 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-7b6b37ef-50b4-4b6a-a7a1-7cd7347b2a39 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:07.589820 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-7b6b37ef-50b4-4b6a-a7a1-7cd7347b2a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:07.675663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:07.687109 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 143/298] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:07.688514 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e96a1-07cd-4132-8042-d044cad35870 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:07.688797 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e96a1-07cd-4132-8042-d044cad35870 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:07.689077 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e96a1-07cd-4132-8042-d044cad35870 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:07.690329 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 144/299] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:07.696408 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4c1f7-718f-4f1d-85bd-79d98a75a093 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:07.696689 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4c1f7-718f-4f1d-85bd-79d98a75a093 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:07.696975 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4c1f7-718f-4f1d-85bd-79d98a75a093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:07.709680 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffae29-70b7-415c-bf51-254fb2191829 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:07.717467 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-70d4c1f7-718f-4f1d-85bd-79d98a75a093 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:07.718907 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-70d4c1f7-718f-4f1d-85bd-79d98a75a093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:07.757991 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa08a82-cd1e-4840-b9d0-07bffa90fd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:07.758637 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa08a82-cd1e-4840-b9d0-07bffa90fd32 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:07.758920 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa08a82-cd1e-4840-b9d0-07bffa90fd32 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:07.759292 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa08a82-cd1e-4840-b9d0-07bffa90fd32 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:07.772335 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa08a82-cd1e-4840-b9d0-07bffa90fd32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:07.778095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-5aa08a82-cd1e-4840-b9d0-07bffa90fd32 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 20:13:07.778095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:07.778095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:07.778095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:07.778095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:07.778095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:07.778095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:07.778095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:07.778095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:07.778095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:07.778095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:07.778095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:07.778095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:07.778095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:07.778095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:07.778095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:07.778966 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:07.778966 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:07.778966 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:07.778966 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:07.778966 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:07.778966 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:07.778966 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:07.778966 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:07.778966 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:07.778966 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:07.778966 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:07.778966 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:07.778966 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:07.778966 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:07.778966 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:07.778966 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:07.780105 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:07.780105 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:07.780105 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:07.780105 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:07.780105 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:07.780105 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:07.780105 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:07.780105 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:07.780105 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:07.780105 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:07.780105 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 20:13:07.780105 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:07.780105 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 156/300] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:07.780763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa08a82-cd1e-4840-b9d0-07bffa90fd32 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:07.797996 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 145/301] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:07.804141 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4c1f7-718f-4f1d-85bd-79d98a75a093 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:07.807741 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:07.895440 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa08a82-cd1e-4840-b9d0-07bffa90fd32 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:07.924837 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4c1f7-718f-4f1d-85bd-79d98a75a093 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:07.931724 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777e284-0a44-4602-8976-557043627ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:07.933130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777e284-0a44-4602-8976-557043627ead None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:07.933417 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777e284-0a44-4602-8976-557043627ead None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:07.933696 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777e284-0a44-4602-8976-557043627ead None admin] PATH_INFO: `/v3/domains/default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:07.934905 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777e284-0a44-4602-8976-557043627ead None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:07.936447 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777e284-0a44-4602-8976-557043627ead None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:07.939185 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 157/302] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:07.939185 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777e284-0a44-4602-8976-557043627ead None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:07.953687 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:07.968989 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965635d-96a4-4d2f-890f-a1e31069c8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:07.969622 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965635d-96a4-4d2f-890f-a1e31069c8eb None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:07.969903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965635d-96a4-4d2f-890f-a1e31069c8eb None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:07.970187 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965635d-96a4-4d2f-890f-a1e31069c8eb None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:07.970890 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965635d-96a4-4d2f-890f-a1e31069c8eb None admin] RBAC: Adding query filter params (name=reader) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:07.971226 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965635d-96a4-4d2f-890f-a1e31069c8eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:07.972606 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965635d-96a4-4d2f-890f-a1e31069c8eb None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:07.981553 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 146/303] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:13:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:07.986673 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965635d-96a4-4d2f-890f-a1e31069c8eb None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:08.054532 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777e284-0a44-4602-8976-557043627ead None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:08.059801 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:08.094749 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc8b4d-0380-476c-930a-a8913116d39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:08.095439 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc8b4d-0380-476c-930a-a8913116d39a None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:08.095718 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc8b4d-0380-476c-930a-a8913116d39a None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:08.095994 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc8b4d-0380-476c-930a-a8913116d39a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:08.105025 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965635d-96a4-4d2f-890f-a1e31069c8eb None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:08.108146 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc8b4d-0380-476c-930a-a8913116d39a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:08.114527 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-7cfc8b4d-0380-476c-930a-a8913116d39a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:13:08.114527 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:08.114527 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:08.114527 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:08.114527 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:08.114527 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:08.114527 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:08.114527 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:08.114527 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:08.114527 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:08.114527 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:08.114527 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:08.114527 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:08.114527 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:08.114527 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:08.114527 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:08.115654 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:08.115654 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:08.115654 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:08.115654 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:08.115654 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:08.115654 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:08.115654 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:08.115654 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:08.115654 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:08.115654 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:08.115654 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:08.115654 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:08.115654 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:08.115654 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:08.115654 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:08.115654 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:08.116483 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:08.116483 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:08.116483 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:08.116483 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:08.116483 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:08.116483 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:08.116483 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:08.116483 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:08.116483 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:08.116483 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:08.116483 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:13:08.116483 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:08.116483 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 158/304] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:08.117214 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc8b4d-0380-476c-930a-a8913116d39a None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:08.148865 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228069dd-b4a0-402f-8d32-c8b578f03467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:08.149917 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228069dd-b4a0-402f-8d32-c8b578f03467 None admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:08.150373 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228069dd-b4a0-402f-8d32-c8b578f03467 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:08.151397 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228069dd-b4a0-402f-8d32-c8b578f03467 None admin] PATH_INFO: `/v3/groups` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:08.152340 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228069dd-b4a0-402f-8d32-c8b578f03467 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:08.154144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228069dd-b4a0-402f-8d32-c8b578f03467 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:08.175613 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 147/305] 10.222.0.83 () {60 vars in 1134 bytes} [Wed Jul 27 20:13:07 2022] POST /identity/v3/groups => generated 229 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:13:08.176479 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228069dd-b4a0-402f-8d32-c8b578f03467 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:08.205950 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:08.245510 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc8b4d-0380-476c-930a-a8913116d39a None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:08.301084 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2483d-c180-43d9-a78d-b68da8c1f0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:08.301760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2483d-c180-43d9-a78d-b68da8c1f0d1 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:08.302043 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2483d-c180-43d9-a78d-b68da8c1f0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:08.302320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2483d-c180-43d9-a78d-b68da8c1f0d1 None admin] PATH_INFO: `/v3/users/ec134a02c24f4d82bce3326e92143afb` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:08.328867 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2483d-c180-43d9-a78d-b68da8c1f0d1 None admin] RBAC: Authorizing `identity:get_user(user_id=ec134a02c24f4d82bce3326e92143afb)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:08.330714 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228069dd-b4a0-402f-8d32-c8b578f03467 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:08.331467 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2483d-c180-43d9-a78d-b68da8c1f0d1 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:08.334386 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 159/306] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:13:08 2022] GET /identity/v3/users/ec134a02c24f4d82bce3326e92143afb => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:08.343578 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2483d-c180-43d9-a78d-b68da8c1f0d1 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:08.361313 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:08.378634 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1ed95-2f8d-4f03-92e9-c6ba3673caee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:08.379569 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1ed95-2f8d-4f03-92e9-c6ba3673caee None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:08.379854 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1ed95-2f8d-4f03-92e9-c6ba3673caee None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:08.380126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1ed95-2f8d-4f03-92e9-c6ba3673caee None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:08.380898 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1ed95-2f8d-4f03-92e9-c6ba3673caee None admin] RBAC: Adding query filter params (name=member) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:08.381204 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1ed95-2f8d-4f03-92e9-c6ba3673caee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:08.382570 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1ed95-2f8d-4f03-92e9-c6ba3673caee None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:08.393542 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 148/307] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:13:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:08.399569 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1ed95-2f8d-4f03-92e9-c6ba3673caee None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:08.475347 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2483d-c180-43d9-a78d-b68da8c1f0d1 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:08.510910 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1ed95-2f8d-4f03-92e9-c6ba3673caee None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:08.511540 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:08.523801 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bc252-1af5-420e-bd23-c734b55be9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:08.524992 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bc252-1af5-420e-bd23-c734b55be9c1 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:08.525544 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bc252-1af5-420e-bd23-c734b55be9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:08.526764 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bc252-1af5-420e-bd23-c734b55be9c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:08.528249 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bc252-1af5-420e-bd23-c734b55be9c1 None admin] RBAC: Adding query filter params (role.id=b166adb7927b4a9fbd2ade12fa51de68, user.id=ec134a02c24f4d82bce3326e92143afb, scope.system=all) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:08.529023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bc252-1af5-420e-bd23-c734b55be9c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:08.531493 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bc252-1af5-420e-bd23-c734b55be9c1 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:08.538742 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 160/308] 10.222.0.83 () {56 vars in 1308 bytes} [Wed Jul 27 20:13:08 2022] GET /identity/v3/role_assignments?user.id=ec134a02c24f4d82bce3326e92143afb&scope.system=all&role.id=b166adb7927b4a9fbd2ade12fa51de68 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:08.553516 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa60d2-55d1-490f-bc89-58038f711201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:08.554232 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa60d2-55d1-490f-bc89-58038f711201 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:08.554521 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa60d2-55d1-490f-bc89-58038f711201 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:08.554799 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa60d2-55d1-490f-bc89-58038f711201 None admin] PATH_INFO: `/v3/users/c62b350acd15482fb3b9fdbf34856009` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:08.556134 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa60d2-55d1-490f-bc89-58038f711201 None admin] RBAC: Authorizing `identity:get_user(user_id=c62b350acd15482fb3b9fdbf34856009)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:08.557738 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa60d2-55d1-490f-bc89-58038f711201 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:08.559691 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 149/309] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:13:08 2022] GET /identity/v3/users/c62b350acd15482fb3b9fdbf34856009 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:08.566014 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bc252-1af5-420e-bd23-c734b55be9c1 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:08.681926 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bc252-1af5-420e-bd23-c734b55be9c1 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:08.721466 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989cdf9-cd2b-47c8-9d02-b98e46c24b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:08.722144 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989cdf9-cd2b-47c8-9d02-b98e46c24b6f None admin] REQUEST_METHOD: `PUT` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:08.722421 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989cdf9-cd2b-47c8-9d02-b98e46c24b6f None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:08.722692 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989cdf9-cd2b-47c8-9d02-b98e46c24b6f None admin] PATH_INFO: `/v3/system/users/c62b350acd15482fb3b9fdbf34856009/roles/13a38ce5696549bf95272ffae43798c8` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:08.724216 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989cdf9-cd2b-47c8-9d02-b98e46c24b6f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c62b350acd15482fb3b9fdbf34856009, role_id=13a38ce5696549bf95272ffae43798c8)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:08.725658 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989cdf9-cd2b-47c8-9d02-b98e46c24b6f None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:08.735652 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 161/310] 10.222.0.83 () {58 vars in 1334 bytes} [Wed Jul 27 20:13:08 2022] PUT /identity/v3/system/users/c62b350acd15482fb3b9fdbf34856009/roles/13a38ce5696549bf95272ffae43798c8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:13:09.162890 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10035f-04e4-4095-9c47-5b59014f2ed2 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:09.163251 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10035f-04e4-4095-9c47-5b59014f2ed2 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:09.163371 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10035f-04e4-4095-9c47-5b59014f2ed2 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:09.164974 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 150/311] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:09.170447 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b354327-610c-4cb6-9148-7bb40167c0b5 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:09.170734 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b354327-610c-4cb6-9148-7bb40167c0b5 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:09.171008 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b354327-610c-4cb6-9148-7bb40167c0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:09.192439 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-5b354327-610c-4cb6-9148-7bb40167c0b5 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:09.193610 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-5b354327-610c-4cb6-9148-7bb40167c0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:09.246031 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:09.264799 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 162/312] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 20:13:09.289274 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10035f-04e4-4095-9c47-5b59014f2ed2 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:09.350579 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:09.400617 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10035f-04e4-4095-9c47-5b59014f2ed2 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:09.449789 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434e3eb-e206-4d57-a102-f4dbf767f9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:09.450359 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434e3eb-e206-4d57-a102-f4dbf767f9c5 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:09.450634 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434e3eb-e206-4d57-a102-f4dbf767f9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:09.450955 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434e3eb-e206-4d57-a102-f4dbf767f9c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:09.461412 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434e3eb-e206-4d57-a102-f4dbf767f9c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:09.466941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-e434e3eb-e206-4d57-a102-f4dbf767f9c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 20:13:09.466941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:09.466941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:09.466941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:09.466941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:09.466941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:09.466941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:09.466941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:09.466941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:09.466941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:09.466941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:09.466941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:09.466941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:09.466941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:09.466941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:09.466941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:09.467895 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:09.467895 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:09.467895 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:09.467895 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:09.467895 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:09.467895 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:09.467895 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:09.467895 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:09.467895 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:09.467895 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:09.467895 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:09.467895 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:09.467895 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:09.467895 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:09.467895 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:09.467895 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:09.468693 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:09.468693 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:09.468693 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:09.468693 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:09.468693 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:09.468693 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:09.468693 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:09.468693 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:09.468693 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:09.468693 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:09.468693 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 20:13:09.468693 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:09.473044 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 151/313] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:09.476166 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b354327-610c-4cb6-9148-7bb40167c0b5 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:09.581583 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b354327-610c-4cb6-9148-7bb40167c0b5 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:09.617056 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df6c30-6474-4655-9084-61079d8503f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:09.617681 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df6c30-6474-4655-9084-61079d8503f8 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:09.617963 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df6c30-6474-4655-9084-61079d8503f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:09.618238 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df6c30-6474-4655-9084-61079d8503f8 None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:09.618965 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df6c30-6474-4655-9084-61079d8503f8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:09.619328 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df6c30-6474-4655-9084-61079d8503f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:09.620711 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df6c30-6474-4655-9084-61079d8503f8 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:09.630194 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 163/314] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:13:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:09.635996 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434e3eb-e206-4d57-a102-f4dbf767f9c5 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:09.741284 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434e3eb-e206-4d57-a102-f4dbf767f9c5 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:09.756203 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:09.780104 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9dd24-db42-4fc1-9270-d0cc6081ef6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:09.780773 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9dd24-db42-4fc1-9270-d0cc6081ef6e None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:09.781057 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9dd24-db42-4fc1-9270-d0cc6081ef6e None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:09.781334 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9dd24-db42-4fc1-9270-d0cc6081ef6e None admin] PATH_INFO: `/v3/users/70f6e5542fb443bda3ffc0e8d8be9411` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:09.782551 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9dd24-db42-4fc1-9270-d0cc6081ef6e None admin] RBAC: Authorizing `identity:get_user(user_id=70f6e5542fb443bda3ffc0e8d8be9411)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:09.784698 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9dd24-db42-4fc1-9270-d0cc6081ef6e None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:09.787673 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 152/315] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:13:09 2022] GET /identity/v3/users/70f6e5542fb443bda3ffc0e8d8be9411 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:09.793850 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df6c30-6474-4655-9084-61079d8503f8 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:09.847918 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:09.908385 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df6c30-6474-4655-9084-61079d8503f8 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:09.944858 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29a20f-8e3a-451a-9270-89059ea377b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:09.945498 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29a20f-8e3a-451a-9270-89059ea377b5 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:09.945780 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29a20f-8e3a-451a-9270-89059ea377b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:09.946056 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29a20f-8e3a-451a-9270-89059ea377b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:10.016598 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29a20f-8e3a-451a-9270-89059ea377b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:10.017987 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29a20f-8e3a-451a-9270-89059ea377b5 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:10.066794 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:10.128531 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 164/316] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:13:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:10.134231 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9dd24-db42-4fc1-9270-d0cc6081ef6e None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:10.250820 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9dd24-db42-4fc1-9270-d0cc6081ef6e None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:10.286395 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bd41c-b408-4302-9b5e-71b0ed48c6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:10.286975 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bd41c-b408-4302-9b5e-71b0ed48c6d7 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:10.287291 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bd41c-b408-4302-9b5e-71b0ed48c6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:10.287568 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bd41c-b408-4302-9b5e-71b0ed48c6d7 None admin] PATH_INFO: `/v3/projects/79b53610ba784f5e9b4c8b6b96c30024` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:10.288738 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bd41c-b408-4302-9b5e-71b0ed48c6d7 None admin] RBAC: Authorizing `identity:get_project(project_id=79b53610ba784f5e9b4c8b6b96c30024)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:10.290192 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bd41c-b408-4302-9b5e-71b0ed48c6d7 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:10.292368 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 153/317] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:13:10 2022] GET /identity/v3/projects/79b53610ba784f5e9b4c8b6b96c30024 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:10.298194 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29a20f-8e3a-451a-9270-89059ea377b5 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:10.403809 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29a20f-8e3a-451a-9270-89059ea377b5 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:10.440994 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f5414-ae5e-413e-8180-bf4b7c890486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:10.441628 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f5414-ae5e-413e-8180-bf4b7c890486 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:10.441905 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f5414-ae5e-413e-8180-bf4b7c890486 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:10.442182 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f5414-ae5e-413e-8180-bf4b7c890486 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:10.442981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f5414-ae5e-413e-8180-bf4b7c890486 None admin] RBAC: Adding query filter params (role.id=b166adb7927b4a9fbd2ade12fa51de68, scope.project.id=79b53610ba784f5e9b4c8b6b96c30024, user.id=70f6e5542fb443bda3ffc0e8d8be9411) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:10.443322 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f5414-ae5e-413e-8180-bf4b7c890486 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:10.445740 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f5414-ae5e-413e-8180-bf4b7c890486 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:10.453019 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 165/318] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:13:10 2022] GET /identity/v3/role_assignments?user.id=70f6e5542fb443bda3ffc0e8d8be9411&scope.project.id=79b53610ba784f5e9b4c8b6b96c30024&role.id=b166adb7927b4a9fbd2ade12fa51de68 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:10.712578 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18c313-64a3-4697-b768-d79efb560188 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:10.713679 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18c313-64a3-4697-b768-d79efb560188 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:10.714074 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18c313-64a3-4697-b768-d79efb560188 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:10.715989 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 154/319] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:10.721883 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044cd62-369e-4380-96ab-95ac5f1102ac None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:10.722424 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044cd62-369e-4380-96ab-95ac5f1102ac None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:10.722658 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044cd62-369e-4380-96ab-95ac5f1102ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:10.741337 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-1044cd62-369e-4380-96ab-95ac5f1102ac None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:10.742525 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-1044cd62-369e-4380-96ab-95ac5f1102ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:10.755354 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:10.820295 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 166/320] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:10.844801 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18c313-64a3-4697-b768-d79efb560188 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:10.857200 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087050e-58d4-4490-87a8-1bfb9f1d3d93 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:10.857493 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087050e-58d4-4490-87a8-1bfb9f1d3d93 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:10.857823 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087050e-58d4-4490-87a8-1bfb9f1d3d93 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:10.859340 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 167/321] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:10.863879 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e909fde-433e-451e-93b2-6a558cf56f40 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:10.864187 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e909fde-433e-451e-93b2-6a558cf56f40 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:10.864437 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e909fde-433e-451e-93b2-6a558cf56f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:10.885311 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-8e909fde-433e-451e-93b2-6a558cf56f40 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:10.886490 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-8e909fde-433e-451e-93b2-6a558cf56f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:10.898172 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:10.955726 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18c313-64a3-4697-b768-d79efb560188 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:10.966688 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 168/322] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 20:13:10.990898 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e909fde-433e-451e-93b2-6a558cf56f40 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:10.993907 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd5ac1-07e8-4194-b8e2-02b9625519c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:10.994593 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd5ac1-07e8-4194-b8e2-02b9625519c9 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:10.994882 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd5ac1-07e8-4194-b8e2-02b9625519c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:10.995191 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd5ac1-07e8-4194-b8e2-02b9625519c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:10.996340 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd5ac1-07e8-4194-b8e2-02b9625519c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:10.997784 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd5ac1-07e8-4194-b8e2-02b9625519c9 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:10.999417 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 155/323] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:11.005398 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd5ac1-07e8-4194-b8e2-02b9625519c9 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:11.065608 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:11.098572 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e909fde-433e-451e-93b2-6a558cf56f40 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:11.108842 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd5ac1-07e8-4194-b8e2-02b9625519c9 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:11.126024 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:11.134217 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14056c2f-4745-4fa9-9f78-510331035433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:11.135495 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14056c2f-4745-4fa9-9f78-510331035433 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:11.135778 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14056c2f-4745-4fa9-9f78-510331035433 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:11.136055 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14056c2f-4745-4fa9-9f78-510331035433 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:11.144167 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215b286-ca5f-441c-97a8-3e90b65515e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:11.144779 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215b286-ca5f-441c-97a8-3e90b65515e0 None admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:11.145057 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215b286-ca5f-441c-97a8-3e90b65515e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:11.145328 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215b286-ca5f-441c-97a8-3e90b65515e0 None admin] PATH_INFO: `/v3/groups` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:11.145956 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14056c2f-4745-4fa9-9f78-510331035433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:11.146049 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215b286-ca5f-441c-97a8-3e90b65515e0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:11.147424 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215b286-ca5f-441c-97a8-3e90b65515e0 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:11.150937 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-14056c2f-4745-4fa9-9f78-510331035433 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 20:13:11.150937 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:11.150937 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:11.150937 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:11.150937 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:11.150937 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:11.150937 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:11.150937 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:11.150937 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:11.150937 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:11.150937 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:11.150937 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:11.150937 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:11.150937 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:11.150937 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:11.150937 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:11.151974 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:11.151974 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:11.151974 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:11.151974 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:11.151974 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:11.151974 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:11.151974 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:11.151974 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:11.151974 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:11.151974 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:11.151974 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:11.151974 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:11.151974 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:11.151974 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:11.151974 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:11.151974 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:11.152885 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:11.152885 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:11.152885 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:11.152885 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:11.152885 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:11.152885 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:11.152885 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:11.152885 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:11.152885 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:11.152885 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:11.152885 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 20:13:11.152885 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:11.152885 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 169/324] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:11.153632 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e1583-ba7a-43af-a065-622f9532bd61 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:11.154176 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e1583-ba7a-43af-a065-622f9532bd61 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:11.154273 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e1583-ba7a-43af-a065-622f9532bd61 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:11.155699 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 170/325] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:11.161381 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e1583-ba7a-43af-a065-622f9532bd61 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:11.166792 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 156/326] 10.222.0.83 () {60 vars in 1134 bytes} [Wed Jul 27 20:13:11 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 20:13:11.168051 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06426397-bb93-4950-bba6-277a84c8a054 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:11.168339 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06426397-bb93-4950-bba6-277a84c8a054 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:11.168615 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06426397-bb93-4950-bba6-277a84c8a054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:11.187833 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-06426397-bb93-4950-bba6-277a84c8a054 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:11.189074 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-06426397-bb93-4950-bba6-277a84c8a054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:11.270808 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 157/327] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:11.292513 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e1583-ba7a-43af-a065-622f9532bd61 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:11.295632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06426397-bb93-4950-bba6-277a84c8a054 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:11.326322 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:11.333768 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ecd1d-56ab-4ab1-8946-a88b31b43a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:11.334400 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ecd1d-56ab-4ab1-8946-a88b31b43a94 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:11.334679 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ecd1d-56ab-4ab1-8946-a88b31b43a94 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:11.334952 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ecd1d-56ab-4ab1-8946-a88b31b43a94 None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:11.335847 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ecd1d-56ab-4ab1-8946-a88b31b43a94 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:11.336276 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ecd1d-56ab-4ab1-8946-a88b31b43a94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:11.338426 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ecd1d-56ab-4ab1-8946-a88b31b43a94 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:11.349540 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 171/328] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:13:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:11.354805 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ecd1d-56ab-4ab1-8946-a88b31b43a94 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:11.423723 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06426397-bb93-4950-bba6-277a84c8a054 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:11.434215 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:11.473489 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be9460-d01c-4296-9f57-ee2fb35f61a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:11.474144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be9460-d01c-4296-9f57-ee2fb35f61a8 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:11.474542 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be9460-d01c-4296-9f57-ee2fb35f61a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:11.475337 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be9460-d01c-4296-9f57-ee2fb35f61a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:11.479522 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ecd1d-56ab-4ab1-8946-a88b31b43a94 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:11.489588 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be9460-d01c-4296-9f57-ee2fb35f61a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:11.495278 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-d9be9460-d01c-4296-9f57-ee2fb35f61a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:13:11.495278 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:11.495278 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:11.495278 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:11.495278 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:11.495278 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:11.495278 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:11.495278 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:11.495278 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:11.495278 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:11.495278 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:11.495278 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:11.495278 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:11.495278 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:11.495278 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:11.495278 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:11.496139 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:11.496139 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:11.496139 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:11.496139 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:11.496139 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:11.496139 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:11.496139 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:11.496139 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:11.496139 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:11.496139 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:11.496139 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:11.496139 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:11.496139 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:11.496139 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:11.496139 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:11.496139 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:11.497152 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:11.497152 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:11.497152 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:11.497152 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:11.497152 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:11.497152 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:11.497152 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:11.497152 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:11.497152 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:11.497152 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:11.497152 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:13:11.497152 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:11.497152 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 158/329] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:13:11.502080 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be9460-d01c-4296-9f57-ee2fb35f61a8 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:11.521730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1261ee1-4493-4c16-8508-f4fc764f1225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:11.522294 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1261ee1-4493-4c16-8508-f4fc764f1225 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:11.522573 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1261ee1-4493-4c16-8508-f4fc764f1225 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:11.522842 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1261ee1-4493-4c16-8508-f4fc764f1225 None admin] PATH_INFO: `/v3/users/ec134a02c24f4d82bce3326e92143afb` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:11.524505 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1261ee1-4493-4c16-8508-f4fc764f1225 None admin] RBAC: Authorizing `identity:get_user(user_id=ec134a02c24f4d82bce3326e92143afb)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:11.525993 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1261ee1-4493-4c16-8508-f4fc764f1225 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:11.528360 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 172/330] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:13:11 2022] GET /identity/v3/users/ec134a02c24f4d82bce3326e92143afb => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:11.533561 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1261ee1-4493-4c16-8508-f4fc764f1225 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:11.614581 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:11.645680 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be9460-d01c-4296-9f57-ee2fb35f61a8 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:11.676236 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1261ee1-4493-4c16-8508-f4fc764f1225 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:11.685116 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d80d2-5cc8-41ee-8196-742a622cb771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:11.685741 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d80d2-5cc8-41ee-8196-742a622cb771 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:11.686020 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d80d2-5cc8-41ee-8196-742a622cb771 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:11.686291 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d80d2-5cc8-41ee-8196-742a622cb771 None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:11.687198 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d80d2-5cc8-41ee-8196-742a622cb771 None admin] RBAC: Adding query filter params (name=member) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:11.687440 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d80d2-5cc8-41ee-8196-742a622cb771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:11.688812 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d80d2-5cc8-41ee-8196-742a622cb771 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:11.698863 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 159/331] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:13:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:11.707365 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d80d2-5cc8-41ee-8196-742a622cb771 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:11.730621 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86f244-8e49-4895-b816-7de6b6d8bec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:11.731545 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86f244-8e49-4895-b816-7de6b6d8bec6 None admin] REQUEST_METHOD: `PUT` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:11.731665 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86f244-8e49-4895-b816-7de6b6d8bec6 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:11.731945 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86f244-8e49-4895-b816-7de6b6d8bec6 None admin] PATH_INFO: `/v3/system/users/ec134a02c24f4d82bce3326e92143afb/roles/b166adb7927b4a9fbd2ade12fa51de68` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:11.733458 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86f244-8e49-4895-b816-7de6b6d8bec6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ec134a02c24f4d82bce3326e92143afb, role_id=b166adb7927b4a9fbd2ade12fa51de68)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:11.734921 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86f244-8e49-4895-b816-7de6b6d8bec6 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:11.747671 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:11.756875 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 173/332] 10.222.0.83 () {58 vars in 1334 bytes} [Wed Jul 27 20:13:11 2022] PUT /identity/v3/system/users/ec134a02c24f4d82bce3326e92143afb/roles/b166adb7927b4a9fbd2ade12fa51de68 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 20:13:11.836832 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d80d2-5cc8-41ee-8196-742a622cb771 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:11.876512 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510d2c1-6c76-4517-b6e6-6893f8e9c49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:11.877421 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510d2c1-6c76-4517-b6e6-6893f8e9c49f None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:11.877708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510d2c1-6c76-4517-b6e6-6893f8e9c49f None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:11.877981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510d2c1-6c76-4517-b6e6-6893f8e9c49f None admin] PATH_INFO: `/v3/users/c62b350acd15482fb3b9fdbf34856009` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:11.879240 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510d2c1-6c76-4517-b6e6-6893f8e9c49f None admin] RBAC: Authorizing `identity:get_user(user_id=c62b350acd15482fb3b9fdbf34856009)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:11.881224 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510d2c1-6c76-4517-b6e6-6893f8e9c49f None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:11.883947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 160/333] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:13:11 2022] GET /identity/v3/users/c62b350acd15482fb3b9fdbf34856009 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:11.889889 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86f244-8e49-4895-b816-7de6b6d8bec6 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:12.004899 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86f244-8e49-4895-b816-7de6b6d8bec6 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:12.031565 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:12.042987 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510ef00-c5e0-4a7c-b1de-0c645579f9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:12.044026 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510ef00-c5e0-4a7c-b1de-0c645579f9d3 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:12.044488 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510ef00-c5e0-4a7c-b1de-0c645579f9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:12.045323 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510ef00-c5e0-4a7c-b1de-0c645579f9d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:12.046350 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510ef00-c5e0-4a7c-b1de-0c645579f9d3 None admin] RBAC: Adding query filter params (role.id=13a38ce5696549bf95272ffae43798c8, user.id=c62b350acd15482fb3b9fdbf34856009, scope.system=all) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:12.046915 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510ef00-c5e0-4a7c-b1de-0c645579f9d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:12.049753 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510ef00-c5e0-4a7c-b1de-0c645579f9d3 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:12.063054 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 174/334] 10.222.0.83 () {56 vars in 1308 bytes} [Wed Jul 27 20:13:11 2022] GET /identity/v3/role_assignments?user.id=c62b350acd15482fb3b9fdbf34856009&scope.system=all&role.id=13a38ce5696549bf95272ffae43798c8 => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:14.033507 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0be09c-22ee-4220-a984-cebe54ab942d None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:14.034291 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0be09c-22ee-4220-a984-cebe54ab942d None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:14.034291 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0be09c-22ee-4220-a984-cebe54ab942d None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:14.035705 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 161/335] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:14.041451 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48e669-7002-4a3b-88bf-996a67270812 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:14.041992 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48e669-7002-4a3b-88bf-996a67270812 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:14.042154 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48e669-7002-4a3b-88bf-996a67270812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:14.066592 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-7b48e669-7002-4a3b-88bf-996a67270812 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:14.072013 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-7b48e669-7002-4a3b-88bf-996a67270812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:14.144993 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a6710-9b05-4944-9f60-73c6d27e6a9a None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:14.145319 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a6710-9b05-4944-9f60-73c6d27e6a9a None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:14.145539 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a6710-9b05-4944-9f60-73c6d27e6a9a None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:14.147170 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 162/336] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:14.152977 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664343e-12c6-4d96-8dde-75ed9ca459bc None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:14.153259 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664343e-12c6-4d96-8dde-75ed9ca459bc None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:14.153531 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664343e-12c6-4d96-8dde-75ed9ca459bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:14.154206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 175/337] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:14.184477 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-5664343e-12c6-4d96-8dde-75ed9ca459bc None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:14.185693 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-5664343e-12c6-4d96-8dde-75ed9ca459bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:14.186711 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48e669-7002-4a3b-88bf-996a67270812 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:14.305424 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48e669-7002-4a3b-88bf-996a67270812 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:14.309324 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 163/338] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 20:13:14.324646 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:14.357060 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664343e-12c6-4d96-8dde-75ed9ca459bc None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:14.363107 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5e9b1-2a85-4b1b-ba84-5f7f1531bf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:14.363819 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5e9b1-2a85-4b1b-ba84-5f7f1531bf29 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:14.364217 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5e9b1-2a85-4b1b-ba84-5f7f1531bf29 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:14.364499 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5e9b1-2a85-4b1b-ba84-5f7f1531bf29 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:14.380332 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5e9b1-2a85-4b1b-ba84-5f7f1531bf29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:14.383222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-02e5e9b1-2a85-4b1b-ba84-5f7f1531bf29 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 20:13:14.383222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:14.383222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:14.383222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:14.383222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:14.383222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:14.383222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:14.383222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:14.383222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:14.383222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:14.383222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:14.383222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:14.383222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:14.383222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:14.383222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:14.383222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:14.384130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:14.384130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:14.384130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:14.384130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:14.384130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:14.384130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:14.384130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:14.384130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:14.384130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:14.384130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:14.384130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:14.384130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:14.384130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:14.384130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:14.384130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:14.384130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:14.385017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:14.385017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:14.385017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:14.385017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:14.385017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:14.385017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:14.385017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:14.385017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:14.385017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:14.385017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:14.385017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 20:13:14.385017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:14.386101 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 176/339] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 27 20:13:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:13:14.392459 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5e9b1-2a85-4b1b-ba84-5f7f1531bf29 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:14.449930 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:14.553140 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5e9b1-2a85-4b1b-ba84-5f7f1531bf29 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:14.566881 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664343e-12c6-4d96-8dde-75ed9ca459bc None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:14.604725 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271eb171-ed73-4c2c-a296-b483548aaafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:14.605355 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271eb171-ed73-4c2c-a296-b483548aaafe None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:14.605685 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271eb171-ed73-4c2c-a296-b483548aaafe None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:14.605962 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271eb171-ed73-4c2c-a296-b483548aaafe None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:14.606682 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271eb171-ed73-4c2c-a296-b483548aaafe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:14.606984 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271eb171-ed73-4c2c-a296-b483548aaafe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:14.608408 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271eb171-ed73-4c2c-a296-b483548aaafe None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:14.621659 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 177/340] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:13:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:14.627962 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271eb171-ed73-4c2c-a296-b483548aaafe None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:14.631763 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97929f04-0c8b-4d9d-b50d-fd1a34f3042c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:14.632437 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97929f04-0c8b-4d9d-b50d-fd1a34f3042c None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:14.633421 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97929f04-0c8b-4d9d-b50d-fd1a34f3042c None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:14.633421 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97929f04-0c8b-4d9d-b50d-fd1a34f3042c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:14.660024 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97929f04-0c8b-4d9d-b50d-fd1a34f3042c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:14.664972 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-97929f04-0c8b-4d9d-b50d-fd1a34f3042c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:13:14.664972 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:14.664972 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:14.664972 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:14.664972 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:14.664972 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:14.664972 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:14.664972 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:14.664972 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:14.664972 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:14.664972 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:14.664972 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:14.664972 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:14.664972 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:14.664972 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:14.664972 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:14.665921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:14.665921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:14.665921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:14.665921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:14.665921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:14.665921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:14.665921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:14.665921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:14.665921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:14.665921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:14.665921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:14.665921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:14.665921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:14.665921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:14.665921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:14.665921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:14.666731 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:14.666731 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:14.666731 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:14.666731 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:14.666731 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:14.666731 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:14.666731 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:14.666731 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:14.666731 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:14.666731 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:14.666731 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:13:14.666731 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:14.670975 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 164/341] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:13:14.672334 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97929f04-0c8b-4d9d-b50d-fd1a34f3042c None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:14.679569 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:14.826755 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271eb171-ed73-4c2c-a296-b483548aaafe None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:14.859461 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:14.880221 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb147c-b52c-49ea-b7dd-b5008453a1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:14.880870 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb147c-b52c-49ea-b7dd-b5008453a1d8 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:14.881124 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb147c-b52c-49ea-b7dd-b5008453a1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:14.881421 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb147c-b52c-49ea-b7dd-b5008453a1d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:14.887236 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97929f04-0c8b-4d9d-b50d-fd1a34f3042c None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:14.963837 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db1ed7-0d1f-4b0f-869d-a330529f921c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:14.964482 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db1ed7-0d1f-4b0f-869d-a330529f921c None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:14.964758 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db1ed7-0d1f-4b0f-869d-a330529f921c None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:14.965027 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db1ed7-0d1f-4b0f-869d-a330529f921c None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:14.965756 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db1ed7-0d1f-4b0f-869d-a330529f921c None admin] RBAC: Adding query filter params (name=member) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:14.966059 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db1ed7-0d1f-4b0f-869d-a330529f921c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:14.967477 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db1ed7-0d1f-4b0f-869d-a330529f921c None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:14.985294 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb147c-b52c-49ea-b7dd-b5008453a1d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:14.986759 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb147c-b52c-49ea-b7dd-b5008453a1d8 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:14.987288 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 165/342] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:13:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:14.988582 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b67092-2eb0-4fc1-93a7-af66b758b1a6 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:14.988867 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b67092-2eb0-4fc1-93a7-af66b758b1a6 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:14.989133 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b67092-2eb0-4fc1-93a7-af66b758b1a6 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:14.992728 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 166/343] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:15.000929 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03761455-9b53-4b04-873f-caab2d8e9346 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:15.001209 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03761455-9b53-4b04-873f-caab2d8e9346 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:15.001482 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03761455-9b53-4b04-873f-caab2d8e9346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:15.031909 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-03761455-9b53-4b04-873f-caab2d8e9346 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:15.033101 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-03761455-9b53-4b04-873f-caab2d8e9346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:15.043427 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:15.149272 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 167/344] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:15.150113 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03761455-9b53-4b04-873f-caab2d8e9346 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:15.165514 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 178/345] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:13:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:15.167123 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a46e4-89a2-4edb-932a-11a7784788f3 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:15.168922 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a46e4-89a2-4edb-932a-11a7784788f3 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:15.169378 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a46e4-89a2-4edb-932a-11a7784788f3 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:15.171589 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 179/346] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:15.174135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a46e4-89a2-4edb-932a-11a7784788f3 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:15.266670 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:15.291554 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03761455-9b53-4b04-873f-caab2d8e9346 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:15.320767 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a46e4-89a2-4edb-932a-11a7784788f3 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:15.337037 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c0ebe-364d-40ce-ace9-98f5a1d66139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:15.338397 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c0ebe-364d-40ce-ace9-98f5a1d66139 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:15.338965 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c0ebe-364d-40ce-ace9-98f5a1d66139 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:15.339410 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c0ebe-364d-40ce-ace9-98f5a1d66139 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:15.364081 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4eb564-9963-4be2-853a-6eab0417d7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:15.365196 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4eb564-9963-4be2-853a-6eab0417d7ed None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:15.366176 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4eb564-9963-4be2-853a-6eab0417d7ed None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:15.366454 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4eb564-9963-4be2-853a-6eab0417d7ed None admin] PATH_INFO: `/v3/projects/d40f8877192d4e139c6e3bd259c38e25` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:15.371220 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4eb564-9963-4be2-853a-6eab0417d7ed None admin] RBAC: Authorizing `identity:get_project(project_id=d40f8877192d4e139c6e3bd259c38e25)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:15.373620 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4eb564-9963-4be2-853a-6eab0417d7ed None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:15.375513 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 180/347] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:13:15 2022] GET /identity/v3/projects/d40f8877192d4e139c6e3bd259c38e25 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:15.376197 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c5e5a-f66c-42ee-b754-b7b078e34191 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:15.376197 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c5e5a-f66c-42ee-b754-b7b078e34191 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:15.379112 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c5e5a-f66c-42ee-b754-b7b078e34191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:15.391224 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:15.411504 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-c85c5e5a-f66c-42ee-b754-b7b078e34191 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:15.412716 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-c85c5e5a-f66c-42ee-b754-b7b078e34191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:15.441472 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c0ebe-364d-40ce-ace9-98f5a1d66139 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:15.443994 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c0ebe-364d-40ce-ace9-98f5a1d66139 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:15.494589 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 181/348] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:15.494589 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c5e5a-f66c-42ee-b754-b7b078e34191 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:15.552404 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:15.577951 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 168/349] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:13:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:15.579308 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c0ebe-364d-40ce-ace9-98f5a1d66139 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:15.612261 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c5e5a-f66c-42ee-b754-b7b078e34191 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:15.643755 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:15.652100 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf001b2-d628-456d-9256-1c45667bb9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:15.653734 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf001b2-d628-456d-9256-1c45667bb9cd None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:15.654269 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf001b2-d628-456d-9256-1c45667bb9cd None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:15.654752 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf001b2-d628-456d-9256-1c45667bb9cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:15.666336 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf001b2-d628-456d-9256-1c45667bb9cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:15.671597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-bbf001b2-d628-456d-9256-1c45667bb9cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:13:15.671597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:15.671597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:15.671597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:15.671597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:15.671597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:15.671597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:15.671597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:15.671597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:15.671597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:15.671597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:15.671597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:15.671597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:15.671597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:15.671597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:15.671597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:15.672494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:15.672494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:15.672494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:15.672494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:15.672494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:15.672494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:15.672494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:15.672494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:15.672494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:15.672494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:15.672494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:15.672494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:15.672494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:15.672494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:15.672494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:15.672494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:15.673283 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:15.673283 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:15.673283 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:15.673283 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:15.673283 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:15.673283 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:15.673283 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:15.673283 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:15.673283 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:15.673283 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:15.673283 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:13:15.673283 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:15.679180 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 182/350] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:15.680316 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf001b2-d628-456d-9256-1c45667bb9cd None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:15.690063 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c0ebe-364d-40ce-ace9-98f5a1d66139 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:15.733419 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d56640-6037-4a40-89c0-faa3114daf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:15.734079 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d56640-6037-4a40-89c0-faa3114daf05 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:15.734359 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d56640-6037-4a40-89c0-faa3114daf05 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:15.734628 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d56640-6037-4a40-89c0-faa3114daf05 None admin] PATH_INFO: `/v3/groups/44d7324b48e6462eb6639fdb1dfe882d` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:15.741423 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d56640-6037-4a40-89c0-faa3114daf05 None admin] RBAC: Authorizing `identity:get_group(group_id=44d7324b48e6462eb6639fdb1dfe882d)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:15.742947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d56640-6037-4a40-89c0-faa3114daf05 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:15.750353 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 169/351] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 27 20:13:15 2022] GET /identity/v3/groups/44d7324b48e6462eb6639fdb1dfe882d => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:15.750353 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d56640-6037-4a40-89c0-faa3114daf05 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:15.805225 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf001b2-d628-456d-9256-1c45667bb9cd None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:15.846881 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f94da3-315f-4219-823c-36f5891a0a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:15.847904 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f94da3-315f-4219-823c-36f5891a0a36 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:15.848337 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f94da3-315f-4219-823c-36f5891a0a36 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:15.848801 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f94da3-315f-4219-823c-36f5891a0a36 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:15.865904 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f94da3-315f-4219-823c-36f5891a0a36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:15.874249 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-55f94da3-315f-4219-823c-36f5891a0a36 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 20:13:15.874249 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:15.874249 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:15.874249 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:15.874249 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:15.874249 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:15.874249 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:15.874249 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:15.874249 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:15.874249 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:15.874249 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:15.874249 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:15.874249 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:15.874249 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:15.874249 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:15.874249 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:15.875788 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:15.875788 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:15.875788 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:15.875788 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:15.875788 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:15.875788 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:15.875788 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:15.875788 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:15.875788 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:15.875788 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:15.875788 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:15.875788 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:15.875788 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:15.875788 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:15.875788 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:15.875788 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:15.876575 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:15.876575 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:15.876575 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:15.876575 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:15.876575 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:15.876575 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:15.876575 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:15.876575 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:15.876575 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:15.876575 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:15.876575 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 20:13:15.876575 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:15.879157 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 183/352] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:15.879681 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d56640-6037-4a40-89c0-faa3114daf05 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:15.880564 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f94da3-315f-4219-823c-36f5891a0a36 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:15.923670 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd887292-724b-4212-a15d-add65d2f9a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:15.924243 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd887292-724b-4212-a15d-add65d2f9a93 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:15.924526 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd887292-724b-4212-a15d-add65d2f9a93 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:15.924798 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd887292-724b-4212-a15d-add65d2f9a93 None admin] PATH_INFO: `/v3/projects/d40f8877192d4e139c6e3bd259c38e25` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:15.925975 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd887292-724b-4212-a15d-add65d2f9a93 None admin] RBAC: Authorizing `identity:get_project(project_id=d40f8877192d4e139c6e3bd259c38e25)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:15.927448 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd887292-724b-4212-a15d-add65d2f9a93 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:15.929471 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:15.929729 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 170/353] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:13:15 2022] GET /identity/v3/projects/d40f8877192d4e139c6e3bd259c38e25 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:15.934375 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd887292-724b-4212-a15d-add65d2f9a93 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:15.946409 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:15.996196 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f94da3-315f-4219-823c-36f5891a0a36 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:16.033883 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7028daf-e8f1-4d55-8426-8adaf8155b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:16.034776 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7028daf-e8f1-4d55-8426-8adaf8155b89 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:16.035208 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7028daf-e8f1-4d55-8426-8adaf8155b89 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:16.035671 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7028daf-e8f1-4d55-8426-8adaf8155b89 None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:16.036530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7028daf-e8f1-4d55-8426-8adaf8155b89 None admin] RBAC: Adding query filter params (name=member) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:16.036937 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7028daf-e8f1-4d55-8426-8adaf8155b89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:16.038490 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7028daf-e8f1-4d55-8426-8adaf8155b89 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:16.051258 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 184/354] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:13:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:16.053083 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7028daf-e8f1-4d55-8426-8adaf8155b89 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:16.053190 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd887292-724b-4212-a15d-add65d2f9a93 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:16.067290 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:16.096395 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2354f-074b-475a-adbd-a4f8b7dfa0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:16.097478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2354f-074b-475a-adbd-a4f8b7dfa0a6 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:16.097761 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2354f-074b-475a-adbd-a4f8b7dfa0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:16.098145 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2354f-074b-475a-adbd-a4f8b7dfa0a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:16.099121 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2354f-074b-475a-adbd-a4f8b7dfa0a6 None admin] RBAC: Adding query filter params (group.id=44d7324b48e6462eb6639fdb1dfe882d, role.id=b63f862c45f24bd8856021d73b8fa0e2, scope.project.id=d40f8877192d4e139c6e3bd259c38e25) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:16.099436 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2354f-074b-475a-adbd-a4f8b7dfa0a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:16.101031 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2354f-074b-475a-adbd-a4f8b7dfa0a6 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:16.109210 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 171/355] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Jul 27 20:13:15 2022] GET /identity/v3/role_assignments?group.id=44d7324b48e6462eb6639fdb1dfe882d&scope.project.id=d40f8877192d4e139c6e3bd259c38e25&role.id=b63f862c45f24bd8856021d73b8fa0e2 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:16.110162 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2354f-074b-475a-adbd-a4f8b7dfa0a6 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:16.206809 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7028daf-e8f1-4d55-8426-8adaf8155b89 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:16.227967 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:16.244320 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2354f-074b-475a-adbd-a4f8b7dfa0a6 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:16.258314 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cabca7-d11b-4ee7-b445-32f9f78668cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:16.258937 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cabca7-d11b-4ee7-b445-32f9f78668cd None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:16.259792 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cabca7-d11b-4ee7-b445-32f9f78668cd None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:16.260066 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cabca7-d11b-4ee7-b445-32f9f78668cd None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:16.260788 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cabca7-d11b-4ee7-b445-32f9f78668cd None admin] RBAC: Adding query filter params (name=reader) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:16.261090 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cabca7-d11b-4ee7-b445-32f9f78668cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:16.262511 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cabca7-d11b-4ee7-b445-32f9f78668cd None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:16.272694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 185/356] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:13:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:16.273717 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02788b79-7b3a-4231-b0b1-5d3acc11cfca None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:16.274000 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02788b79-7b3a-4231-b0b1-5d3acc11cfca None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:16.274272 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02788b79-7b3a-4231-b0b1-5d3acc11cfca None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:16.276362 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 186/357] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:16.277064 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02788b79-7b3a-4231-b0b1-5d3acc11cfca None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:16.290973 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658051e2-d3c0-4930-b79b-20d8eea30d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:16.291624 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658051e2-d3c0-4930-b79b-20d8eea30d0d None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:16.291903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658051e2-d3c0-4930-b79b-20d8eea30d0d None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:16.292176 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658051e2-d3c0-4930-b79b-20d8eea30d0d None admin] PATH_INFO: `/v3/groups/44d7324b48e6462eb6639fdb1dfe882d` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:16.293373 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658051e2-d3c0-4930-b79b-20d8eea30d0d None admin] RBAC: Authorizing `identity:get_group(group_id=44d7324b48e6462eb6639fdb1dfe882d)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:16.295030 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658051e2-d3c0-4930-b79b-20d8eea30d0d None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:16.297157 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 172/358] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 27 20:13:16 2022] GET /identity/v3/groups/44d7324b48e6462eb6639fdb1dfe882d => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:16.298075 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658051e2-d3c0-4930-b79b-20d8eea30d0d None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:16.366564 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:16.434315 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658051e2-d3c0-4930-b79b-20d8eea30d0d None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:16.456437 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02788b79-7b3a-4231-b0b1-5d3acc11cfca None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:16.487241 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8088fb2-cd6b-4f5a-a2c2-4002df0f60be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:16.487241 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8088fb2-cd6b-4f5a-a2c2-4002df0f60be None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:16.487241 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8088fb2-cd6b-4f5a-a2c2-4002df0f60be None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:16.487241 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8088fb2-cd6b-4f5a-a2c2-4002df0f60be None admin] PATH_INFO: `/v3/users/ec134a02c24f4d82bce3326e92143afb` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:16.489847 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8088fb2-cd6b-4f5a-a2c2-4002df0f60be None admin] RBAC: Authorizing `identity:get_user(user_id=ec134a02c24f4d82bce3326e92143afb)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:16.491248 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8088fb2-cd6b-4f5a-a2c2-4002df0f60be None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:16.493429 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 173/359] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 27 20:13:16 2022] GET /identity/v3/users/ec134a02c24f4d82bce3326e92143afb => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:16.494073 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ce248-5186-4a1b-b69c-d8df01976ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:16.494771 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ce248-5186-4a1b-b69c-d8df01976ffe None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:16.495059 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ce248-5186-4a1b-b69c-d8df01976ffe None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:16.495279 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec44d5-93d2-40eb-8bbb-08a98d0b0132 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:16.495377 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ce248-5186-4a1b-b69c-d8df01976ffe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:16.495554 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec44d5-93d2-40eb-8bbb-08a98d0b0132 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:16.495815 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec44d5-93d2-40eb-8bbb-08a98d0b0132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:16.517602 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-a7ec44d5-93d2-40eb-8bbb-08a98d0b0132 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:16.518321 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-a7ec44d5-93d2-40eb-8bbb-08a98d0b0132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:16.549036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:16.584367 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ce248-5186-4a1b-b69c-d8df01976ffe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:16.585853 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ce248-5186-4a1b-b69c-d8df01976ffe None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:16.636114 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 174/360] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:16.636803 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec44d5-93d2-40eb-8bbb-08a98d0b0132 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:16.703920 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:16.785851 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 187/361] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:13:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:16.787376 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183efbfa-fb95-471a-98b5-48543c618e28 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:16.787812 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183efbfa-fb95-471a-98b5-48543c618e28 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:16.788232 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183efbfa-fb95-471a-98b5-48543c618e28 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:16.789594 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 188/362] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:16.797835 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183efbfa-fb95-471a-98b5-48543c618e28 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:16.822184 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec44d5-93d2-40eb-8bbb-08a98d0b0132 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:16.905903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffb8fe-b566-4702-85af-4f49f391b1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:16.909345 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffb8fe-b566-4702-85af-4f49f391b1c3 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:16.910129 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffb8fe-b566-4702-85af-4f49f391b1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:16.910277 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffb8fe-b566-4702-85af-4f49f391b1c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:16.911846 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ffb8fe-b566-4702-85af-4f49f391b1c3 None admin] RBAC: Adding query filter params (group.id=44d7324b48e6462eb6639fdb1dfe882d, role.id=13a38ce5696549bf95272ffae43798c8, scope.project.id=d40f8877192d4e139c6e3bd259c38e25) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:16.911846 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ffb8fe-b566-4702-85af-4f49f391b1c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:16.913114 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ffb8fe-b566-4702-85af-4f49f391b1c3 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:16.921276 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 175/363] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Jul 27 20:13:16 2022] GET /identity/v3/role_assignments?group.id=44d7324b48e6462eb6639fdb1dfe882d&scope.project.id=d40f8877192d4e139c6e3bd259c38e25&role.id=13a38ce5696549bf95272ffae43798c8 => generated 260 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:16.927104 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffb8fe-b566-4702-85af-4f49f391b1c3 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:16.934414 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:16.995672 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183efbfa-fb95-471a-98b5-48543c618e28 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:17.049811 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a346d-d10e-4388-a5e0-4ec6b67cf8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:17.050367 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a346d-d10e-4388-a5e0-4ec6b67cf8e5 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:17.050647 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a346d-d10e-4388-a5e0-4ec6b67cf8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:17.051145 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a346d-d10e-4388-a5e0-4ec6b67cf8e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:17.052038 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a346d-d10e-4388-a5e0-4ec6b67cf8e5 None admin] RBAC: Adding query filter params (role.id=b166adb7927b4a9fbd2ade12fa51de68, user.id=ec134a02c24f4d82bce3326e92143afb, scope.system=all) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:17.052580 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a346d-d10e-4388-a5e0-4ec6b67cf8e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:17.053806 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a346d-d10e-4388-a5e0-4ec6b67cf8e5 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:17.067846 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 189/364] 10.222.0.83 () {56 vars in 1308 bytes} [Wed Jul 27 20:13:16 2022] GET /identity/v3/role_assignments?user.id=ec134a02c24f4d82bce3326e92143afb&scope.system=all&role.id=b166adb7927b4a9fbd2ade12fa51de68 => generated 510 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:17.069038 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a346d-d10e-4388-a5e0-4ec6b67cf8e5 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:17.085807 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffb8fe-b566-4702-85af-4f49f391b1c3 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:17.097526 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:17.132573 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcc139-a910-473d-afa8-12875141baad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:17.133248 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcc139-a910-473d-afa8-12875141baad None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:17.133532 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcc139-a910-473d-afa8-12875141baad None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:17.133806 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcc139-a910-473d-afa8-12875141baad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:17.152081 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddcc139-a910-473d-afa8-12875141baad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:17.158601 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-bddcc139-a910-473d-afa8-12875141baad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 20:13:17.158601 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:17.158601 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:17.158601 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:17.158601 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:17.158601 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:17.158601 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:17.158601 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:17.158601 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:17.158601 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:17.158601 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:17.158601 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:17.158601 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:17.158601 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:17.158601 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:17.158601 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:17.159615 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:17.159615 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:17.159615 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:17.159615 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:17.159615 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:17.159615 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:17.159615 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:17.159615 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:17.159615 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:17.159615 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:17.159615 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:17.159615 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:17.159615 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:17.159615 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:17.159615 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:17.159615 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:17.161237 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:17.161237 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:17.161237 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:17.161237 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:17.161237 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:17.161237 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:17.161237 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:17.161237 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:17.161237 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:17.161237 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:17.161237 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 20:13:17.161237 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:17.161237 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 176/365] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 27 20:13:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:17.161237 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53024547-9f1a-46d3-ad6d-ae1bf9d535bd None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:17.163151 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53024547-9f1a-46d3-ad6d-ae1bf9d535bd None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:17.163151 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53024547-9f1a-46d3-ad6d-ae1bf9d535bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:17.191608 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-53024547-9f1a-46d3-ad6d-ae1bf9d535bd None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:17.192884 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-53024547-9f1a-46d3-ad6d-ae1bf9d535bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:17.211016 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a346d-d10e-4388-a5e0-4ec6b67cf8e5 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:17.256321 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa2930-87b5-4864-ba07-88ec489cd00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:17.257687 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa2930-87b5-4864-ba07-88ec489cd00e None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:17.258246 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa2930-87b5-4864-ba07-88ec489cd00e None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:17.258667 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa2930-87b5-4864-ba07-88ec489cd00e None admin] PATH_INFO: `/v3/projects/79b53610ba784f5e9b4c8b6b96c30024` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:17.260723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa2930-87b5-4864-ba07-88ec489cd00e None admin] RBAC: Authorizing `identity:get_project(project_id=79b53610ba784f5e9b4c8b6b96c30024)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:17.262514 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa2930-87b5-4864-ba07-88ec489cd00e None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:17.265179 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 190/366] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:13:17 2022] GET /identity/v3/projects/79b53610ba784f5e9b4c8b6b96c30024 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:17.266178 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa2930-87b5-4864-ba07-88ec489cd00e None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:17.269673 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:17.291222 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 177/367] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:17.292735 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53024547-9f1a-46d3-ad6d-ae1bf9d535bd None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:17.426155 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa2930-87b5-4864-ba07-88ec489cd00e None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:17.464048 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:17.473488 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53024547-9f1a-46d3-ad6d-ae1bf9d535bd None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:17.497667 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a07db-bbd3-4283-a07d-3e94dded6547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:17.498321 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a07db-bbd3-4283-a07d-3e94dded6547 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:17.498606 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a07db-bbd3-4283-a07d-3e94dded6547 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:17.498882 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a07db-bbd3-4283-a07d-3e94dded6547 None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:17.499672 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a07db-bbd3-4283-a07d-3e94dded6547 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:17.499984 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a07db-bbd3-4283-a07d-3e94dded6547 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:17.501566 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a07db-bbd3-4283-a07d-3e94dded6547 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:17.516760 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9c777-9628-417c-8544-1039b94c1ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:17.517404 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 191/368] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:13:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:17.518314 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9c777-9628-417c-8544-1039b94c1ec6 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:17.518830 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9c777-9628-417c-8544-1039b94c1ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:17.519404 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9c777-9628-417c-8544-1039b94c1ec6 None admin] PATH_INFO: `/v3/groups/44d7324b48e6462eb6639fdb1dfe882d` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:17.521017 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9c777-9628-417c-8544-1039b94c1ec6 None admin] RBAC: Authorizing `identity:get_group(group_id=44d7324b48e6462eb6639fdb1dfe882d)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:17.522863 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a07db-bbd3-4283-a07d-3e94dded6547 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:17.523113 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9c777-9628-417c-8544-1039b94c1ec6 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:17.525774 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 178/369] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 27 20:13:17 2022] GET /identity/v3/groups/44d7324b48e6462eb6639fdb1dfe882d => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:17.526826 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9c777-9628-417c-8544-1039b94c1ec6 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:17.607330 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:17.653231 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a07db-bbd3-4283-a07d-3e94dded6547 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:17.671659 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9c777-9628-417c-8544-1039b94c1ec6 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:17.696474 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520b371-3521-4056-9e95-0db6e93db85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:17.696474 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520b371-3521-4056-9e95-0db6e93db85d None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:17.696474 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520b371-3521-4056-9e95-0db6e93db85d None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:17.696474 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520b371-3521-4056-9e95-0db6e93db85d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:17.707593 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520b371-3521-4056-9e95-0db6e93db85d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:17.713637 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-d520b371-3521-4056-9e95-0db6e93db85d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:13:17.713637 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:17.713637 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:17.713637 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:17.713637 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:17.713637 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:17.713637 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:17.713637 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:17.713637 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:17.713637 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:17.713637 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:17.713637 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:17.713637 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:17.713637 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:17.713637 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:17.713637 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:17.714560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:17.714560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:17.714560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:17.714560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:17.714560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:17.714560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:17.714560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:17.714560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:17.714560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:17.714560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:17.714560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:17.714560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:17.714560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:17.714560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:17.714560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:17.714560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:17.716096 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:17.716096 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:17.716096 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:17.716096 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:17.716096 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:17.716096 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:17.716096 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:17.716096 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:17.716096 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:17.716096 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:17.716096 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:13:17.716096 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:17.716096 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 192/370] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 27 20:13:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:17.716096 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520b371-3521-4056-9e95-0db6e93db85d None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:17.748472 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1e657-412d-4046-a562-9246edbce51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:17.749106 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1e657-412d-4046-a562-9246edbce51b None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:17.749387 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1e657-412d-4046-a562-9246edbce51b None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:17.749659 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1e657-412d-4046-a562-9246edbce51b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:17.787673 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:17.828272 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1e657-412d-4046-a562-9246edbce51b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:17.829768 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1e657-412d-4046-a562-9246edbce51b None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:17.864960 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520b371-3521-4056-9e95-0db6e93db85d None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:17.891739 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:17.905539 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba986e8b-9f71-45a2-813d-2830f8bb0751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:17.906400 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba986e8b-9f71-45a2-813d-2830f8bb0751 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:17.906819 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba986e8b-9f71-45a2-813d-2830f8bb0751 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:17.907297 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba986e8b-9f71-45a2-813d-2830f8bb0751 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:17.908242 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba986e8b-9f71-45a2-813d-2830f8bb0751 None admin] RBAC: Adding query filter params (group.id=44d7324b48e6462eb6639fdb1dfe882d, role.id=13a38ce5696549bf95272ffae43798c8, scope.project.id=79b53610ba784f5e9b4c8b6b96c30024) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:17.908691 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba986e8b-9f71-45a2-813d-2830f8bb0751 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:17.910407 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba986e8b-9f71-45a2-813d-2830f8bb0751 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:17.917421 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 193/371] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Jul 27 20:13:17 2022] GET /identity/v3/role_assignments?group.id=44d7324b48e6462eb6639fdb1dfe882d&scope.project.id=79b53610ba784f5e9b4c8b6b96c30024&role.id=13a38ce5696549bf95272ffae43798c8 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:17.918490 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba986e8b-9f71-45a2-813d-2830f8bb0751 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:17.945676 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 179/372] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:13:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:17.952528 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1e657-412d-4046-a562-9246edbce51b None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:18.033582 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba986e8b-9f71-45a2-813d-2830f8bb0751 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:18.075763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c318512-c824-4f27-83e1-4baab1533079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:18.077079 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c318512-c824-4f27-83e1-4baab1533079 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:18.077539 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c318512-c824-4f27-83e1-4baab1533079 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:18.077969 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c318512-c824-4f27-83e1-4baab1533079 None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:18.078874 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c318512-c824-4f27-83e1-4baab1533079 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:18.079521 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c318512-c824-4f27-83e1-4baab1533079 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:18.081341 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c318512-c824-4f27-83e1-4baab1533079 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:18.084653 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:18.095616 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 194/373] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:18.104647 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c318512-c824-4f27-83e1-4baab1533079 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:18.146478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1e657-412d-4046-a562-9246edbce51b None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:18.176407 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:18.196127 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdc193-7851-4557-a1ff-93b9b66c3ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:18.197323 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdc193-7851-4557-a1ff-93b9b66c3ffb None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:18.197605 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdc193-7851-4557-a1ff-93b9b66c3ffb None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:18.197878 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdc193-7851-4557-a1ff-93b9b66c3ffb None admin] PATH_INFO: `/v3/projects/79b53610ba784f5e9b4c8b6b96c30024` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:18.200280 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bdc193-7851-4557-a1ff-93b9b66c3ffb None admin] RBAC: Authorizing `identity:get_project(project_id=79b53610ba784f5e9b4c8b6b96c30024)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:18.200552 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bdc193-7851-4557-a1ff-93b9b66c3ffb None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:18.202757 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 180/374] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:13:17 2022] GET /identity/v3/projects/79b53610ba784f5e9b4c8b6b96c30024 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:18.208364 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdc193-7851-4557-a1ff-93b9b66c3ffb None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:18.245406 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c318512-c824-4f27-83e1-4baab1533079 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:18.292864 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c348f0-42ce-4993-aab6-b04612565100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:18.293723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c348f0-42ce-4993-aab6-b04612565100 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:18.294592 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c348f0-42ce-4993-aab6-b04612565100 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:18.295298 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c348f0-42ce-4993-aab6-b04612565100 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:18.342697 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdc193-7851-4557-a1ff-93b9b66c3ffb None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:18.378008 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:18.385784 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcec0a-7afa-4bba-9f2f-45e940de5d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:18.386095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c348f0-42ce-4993-aab6-b04612565100 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:18.386440 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcec0a-7afa-4bba-9f2f-45e940de5d12 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:18.386722 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcec0a-7afa-4bba-9f2f-45e940de5d12 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:18.386993 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcec0a-7afa-4bba-9f2f-45e940de5d12 None admin] PATH_INFO: `/v3/groups/44d7324b48e6462eb6639fdb1dfe882d` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:18.388233 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdcec0a-7afa-4bba-9f2f-45e940de5d12 None admin] RBAC: Authorizing `identity:get_group(group_id=44d7324b48e6462eb6639fdb1dfe882d)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:18.388560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c348f0-42ce-4993-aab6-b04612565100 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:18.389716 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdcec0a-7afa-4bba-9f2f-45e940de5d12 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:18.392329 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 181/375] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 27 20:13:18 2022] GET /identity/v3/groups/44d7324b48e6462eb6639fdb1dfe882d => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:18.400241 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcec0a-7afa-4bba-9f2f-45e940de5d12 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:18.448100 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:18.508383 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 195/376] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:13:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 20:13:18.520093 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c348f0-42ce-4993-aab6-b04612565100 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:18.572519 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcec0a-7afa-4bba-9f2f-45e940de5d12 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:18.615273 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ced25-f7e1-4104-a3d5-3427627f4b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:18.616902 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ced25-f7e1-4104-a3d5-3427627f4b82 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:18.617879 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ced25-f7e1-4104-a3d5-3427627f4b82 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:18.618580 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ced25-f7e1-4104-a3d5-3427627f4b82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:18.621668 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ced25-f7e1-4104-a3d5-3427627f4b82 None admin] RBAC: Adding query filter params (group.id=44d7324b48e6462eb6639fdb1dfe882d, role.id=b63f862c45f24bd8856021d73b8fa0e2, scope.project.id=79b53610ba784f5e9b4c8b6b96c30024) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:18.622153 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ced25-f7e1-4104-a3d5-3427627f4b82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:18.624792 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ced25-f7e1-4104-a3d5-3427627f4b82 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:18.639861 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 182/377] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Jul 27 20:13:18 2022] GET /identity/v3/role_assignments?group.id=44d7324b48e6462eb6639fdb1dfe882d&scope.project.id=79b53610ba784f5e9b4c8b6b96c30024&role.id=b63f862c45f24bd8856021d73b8fa0e2 => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:18.675801 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c348f0-42ce-4993-aab6-b04612565100 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:18.724168 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd0e88-e9b0-4e35-92dc-ab3364741a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:18.725059 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd0e88-e9b0-4e35-92dc-ab3364741a3a None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:18.725503 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd0e88-e9b0-4e35-92dc-ab3364741a3a None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:18.725916 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd0e88-e9b0-4e35-92dc-ab3364741a3a None admin] PATH_INFO: `/v3/projects/85a972f1c766490294ece49f734d7df0` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:18.730802 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd0e88-e9b0-4e35-92dc-ab3364741a3a None admin] RBAC: Authorizing `identity:get_project(project_id=85a972f1c766490294ece49f734d7df0)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:18.732527 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd0e88-e9b0-4e35-92dc-ab3364741a3a None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:18.734713 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 196/378] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:13:18 2022] GET /identity/v3/projects/85a972f1c766490294ece49f734d7df0 => generated 344 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:18.740489 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ced25-f7e1-4104-a3d5-3427627f4b82 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:18.833950 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:18.889090 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ced25-f7e1-4104-a3d5-3427627f4b82 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:18.935845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713d3af-cc95-406f-a11a-cf671939b781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:18.936425 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713d3af-cc95-406f-a11a-cf671939b781 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:18.936709 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713d3af-cc95-406f-a11a-cf671939b781 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:18.936984 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713d3af-cc95-406f-a11a-cf671939b781 None admin] PATH_INFO: `/v3/groups/1da1995c3eda4ae59dae6dda17a84fbd` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:18.945646 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713d3af-cc95-406f-a11a-cf671939b781 None admin] RBAC: Authorizing `identity:get_group(group_id=1da1995c3eda4ae59dae6dda17a84fbd)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:18.947790 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713d3af-cc95-406f-a11a-cf671939b781 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:18.949823 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 183/379] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 27 20:13:18 2022] GET /identity/v3/groups/1da1995c3eda4ae59dae6dda17a84fbd => generated 229 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:18.955700 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd0e88-e9b0-4e35-92dc-ab3364741a3a None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:18.984621 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:19.092955 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd0e88-e9b0-4e35-92dc-ab3364741a3a None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:19.127882 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7d7c0-7065-4db0-9795-f89e094cb0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:19.128499 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7d7c0-7065-4db0-9795-f89e094cb0d5 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:19.128772 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7d7c0-7065-4db0-9795-f89e094cb0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:19.129040 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7d7c0-7065-4db0-9795-f89e094cb0d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:19.129815 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7d7c0-7065-4db0-9795-f89e094cb0d5 None admin] RBAC: Adding query filter params (group.id=1da1995c3eda4ae59dae6dda17a84fbd, role.id=df8ec36d044b469d8854eba8394eb107, scope.project.id=85a972f1c766490294ece49f734d7df0) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:19.130123 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7d7c0-7065-4db0-9795-f89e094cb0d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:19.131584 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7d7c0-7065-4db0-9795-f89e094cb0d5 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:19.140340 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 197/380] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Jul 27 20:13:18 2022] GET /identity/v3/role_assignments?group.id=1da1995c3eda4ae59dae6dda17a84fbd&scope.project.id=85a972f1c766490294ece49f734d7df0&role.id=df8ec36d044b469d8854eba8394eb107 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:19.173067 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d0ef1-7c05-4a66-a279-45899e35764a None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:19.173359 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d0ef1-7c05-4a66-a279-45899e35764a None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:19.173632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d0ef1-7c05-4a66-a279-45899e35764a None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:19.175520 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 184/381] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:19.181477 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288a3b1-cf5a-4e1f-af7b-43692062bff6 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:19.181879 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288a3b1-cf5a-4e1f-af7b-43692062bff6 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:19.182160 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288a3b1-cf5a-4e1f-af7b-43692062bff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:19.208275 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-9288a3b1-cf5a-4e1f-af7b-43692062bff6 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:19.209423 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-9288a3b1-cf5a-4e1f-af7b-43692062bff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:19.293702 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 198/382] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:19.341085 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d0ef1-7c05-4a66-a279-45899e35764a None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:19.457948 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d0ef1-7c05-4a66-a279-45899e35764a None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:19.487302 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:19.500484 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906a9e8-a450-434c-98f5-944c6c90988b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:19.501189 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906a9e8-a450-434c-98f5-944c6c90988b None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:19.501474 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906a9e8-a450-434c-98f5-944c6c90988b None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:19.501998 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906a9e8-a450-434c-98f5-944c6c90988b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:19.515061 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906a9e8-a450-434c-98f5-944c6c90988b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:19.520102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-2906a9e8-a450-434c-98f5-944c6c90988b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 20:13:19.520102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:19.520102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:19.520102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:19.520102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:19.520102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:19.520102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:19.520102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:19.520102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:19.520102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:19.520102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:19.520102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:19.520102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:19.520102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:19.520102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:19.520102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:19.520985 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:19.520985 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:19.520985 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:19.520985 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:19.520985 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:19.520985 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:19.520985 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:19.520985 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:19.520985 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:19.520985 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:19.520985 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:19.520985 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:19.520985 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:19.520985 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:19.520985 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:19.520985 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:19.521771 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:19.521771 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:19.521771 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:19.521771 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:19.521771 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:19.521771 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:19.521771 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:19.521771 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:19.521771 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:19.521771 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:19.521771 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 20:13:19.521771 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:19.526246 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 185/383] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 27 20:13:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:19.527684 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288a3b1-cf5a-4e1f-af7b-43692062bff6 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:19.556570 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:19.686310 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288a3b1-cf5a-4e1f-af7b-43692062bff6 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:19.723397 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03381009-22f6-4cb5-a2c9-3cdadf536551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:19.724024 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03381009-22f6-4cb5-a2c9-3cdadf536551 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:19.724302 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03381009-22f6-4cb5-a2c9-3cdadf536551 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:19.724574 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03381009-22f6-4cb5-a2c9-3cdadf536551 None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:19.725293 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03381009-22f6-4cb5-a2c9-3cdadf536551 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:19.725593 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03381009-22f6-4cb5-a2c9-3cdadf536551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:19.726973 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03381009-22f6-4cb5-a2c9-3cdadf536551 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:19.739031 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 199/384] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:13:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:19.745045 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906a9e8-a450-434c-98f5-944c6c90988b None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:19.772494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac4ac4-7d45-41c0-bdf9-68a543e40231 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:19.772494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac4ac4-7d45-41c0-bdf9-68a543e40231 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:19.772931 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac4ac4-7d45-41c0-bdf9-68a543e40231 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:19.774409 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 200/385] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:19.800032 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1c3ce-6918-4f05-accf-00aa21901241 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:19.800663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1c3ce-6918-4f05-accf-00aa21901241 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:19.801148 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1c3ce-6918-4f05-accf-00aa21901241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:19.830758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-23d1c3ce-6918-4f05-accf-00aa21901241 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:19.831980 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-23d1c3ce-6918-4f05-accf-00aa21901241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:19.963708 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 201/386] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 20:13:19.970531 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906a9e8-a450-434c-98f5-944c6c90988b None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:20.000567 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1c3ce-6918-4f05-accf-00aa21901241 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:20.004082 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:20.014737 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46271c49-b2e7-4753-8cc2-d626db2164b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:20.015424 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46271c49-b2e7-4753-8cc2-d626db2164b4 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:20.015701 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46271c49-b2e7-4753-8cc2-d626db2164b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:20.015973 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46271c49-b2e7-4753-8cc2-d626db2164b4 None admin] PATH_INFO: `/v3/groups/44d7324b48e6462eb6639fdb1dfe882d` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:20.019768 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46271c49-b2e7-4753-8cc2-d626db2164b4 None admin] RBAC: Authorizing `identity:get_group(group_id=44d7324b48e6462eb6639fdb1dfe882d)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:20.021229 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46271c49-b2e7-4753-8cc2-d626db2164b4 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:20.023182 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 186/387] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 27 20:13:19 2022] GET /identity/v3/groups/44d7324b48e6462eb6639fdb1dfe882d => generated 226 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:20.028914 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46271c49-b2e7-4753-8cc2-d626db2164b4 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:20.096734 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:20.121519 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1c3ce-6918-4f05-accf-00aa21901241 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:20.148649 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46271c49-b2e7-4753-8cc2-d626db2164b4 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:20.162987 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d91dfa-7e6c-4b9f-9a96-7a16c2a51ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:20.163672 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d91dfa-7e6c-4b9f-9a96-7a16c2a51ce9 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:20.163955 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d91dfa-7e6c-4b9f-9a96-7a16c2a51ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:20.164234 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d91dfa-7e6c-4b9f-9a96-7a16c2a51ce9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:20.180788 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d91dfa-7e6c-4b9f-9a96-7a16c2a51ce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:20.184057 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1cd1e-4a30-46c5-bc7c-c39329b46fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:20.184778 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1cd1e-4a30-46c5-bc7c-c39329b46fc4 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:20.185130 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1cd1e-4a30-46c5-bc7c-c39329b46fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:20.185482 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1cd1e-4a30-46c5-bc7c-c39329b46fc4 None admin] PATH_INFO: `/v3/projects/d40f8877192d4e139c6e3bd259c38e25` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:20.186190 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-e0d91dfa-7e6c-4b9f-9a96-7a16c2a51ce9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:13:20.186190 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:20.186190 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:20.186190 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:20.186190 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:20.186190 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:20.186190 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:20.186190 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:20.186190 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:20.186190 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:20.186190 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:20.186190 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:20.186190 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:20.186190 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:20.186190 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:20.186190 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:20.187036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:20.187036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:20.187036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:20.187036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:20.187036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:20.187036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:20.187036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:20.187036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:20.187036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:20.187036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:20.187036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:20.187036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:20.187036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:20.187036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:20.187036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:20.187036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:20.187867 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:20.187867 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:20.187867 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:20.187867 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:20.187867 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:20.187867 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:20.187867 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:20.187867 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:20.187867 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:20.187867 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:20.187867 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:13:20.187867 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:20.189138 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1cd1e-4a30-46c5-bc7c-c39329b46fc4 None admin] RBAC: Authorizing `identity:get_project(project_id=d40f8877192d4e139c6e3bd259c38e25)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:20.189264 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 202/388] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:13:20.189383 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1cd1e-4a30-46c5-bc7c-c39329b46fc4 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:20.190853 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 187/389] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:13:20 2022] GET /identity/v3/projects/d40f8877192d4e139c6e3bd259c38e25 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:20.197792 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d91dfa-7e6c-4b9f-9a96-7a16c2a51ce9 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:20.199672 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1cd1e-4a30-46c5-bc7c-c39329b46fc4 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:20.331460 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:20.407798 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d91dfa-7e6c-4b9f-9a96-7a16c2a51ce9 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:20.421284 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1cd1e-4a30-46c5-bc7c-c39329b46fc4 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:20.463842 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:20.478709 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f5f40-e71b-43e9-8b2c-9cd33513a967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:20.479416 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f5f40-e71b-43e9-8b2c-9cd33513a967 None admin] REQUEST_METHOD: `PUT` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:20.479695 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f5f40-e71b-43e9-8b2c-9cd33513a967 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:20.479971 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f5f40-e71b-43e9-8b2c-9cd33513a967 None admin] PATH_INFO: `/v3/projects/d40f8877192d4e139c6e3bd259c38e25/groups/44d7324b48e6462eb6639fdb1dfe882d/roles/b63f862c45f24bd8856021d73b8fa0e2` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:20.483453 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f5f40-e71b-43e9-8b2c-9cd33513a967 None admin] RBAC: Authorizing `identity:create_grant(project_id=d40f8877192d4e139c6e3bd259c38e25, group_id=44d7324b48e6462eb6639fdb1dfe882d, role_id=b63f862c45f24bd8856021d73b8fa0e2)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:20.484909 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f5f40-e71b-43e9-8b2c-9cd33513a967 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:20.488590 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822551d7-6002-4dd6-b73c-0c4b35e0c83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:20.489215 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822551d7-6002-4dd6-b73c-0c4b35e0c83a None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:20.489497 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822551d7-6002-4dd6-b73c-0c4b35e0c83a None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:20.489774 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822551d7-6002-4dd6-b73c-0c4b35e0c83a None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:20.490498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822551d7-6002-4dd6-b73c-0c4b35e0c83a None admin] RBAC: Adding query filter params (name=member) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:20.490809 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822551d7-6002-4dd6-b73c-0c4b35e0c83a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:20.492263 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822551d7-6002-4dd6-b73c-0c4b35e0c83a None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:20.503847 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 188/390] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:13:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:20.510810 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822551d7-6002-4dd6-b73c-0c4b35e0c83a None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:20.520050 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 203/391] 10.222.0.83 () {58 vars in 1442 bytes} [Wed Jul 27 20:13:20 2022] PUT /identity/v3/projects/d40f8877192d4e139c6e3bd259c38e25/groups/44d7324b48e6462eb6639fdb1dfe882d/roles/b63f862c45f24bd8856021d73b8fa0e2 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:13:20.641086 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822551d7-6002-4dd6-b73c-0c4b35e0c83a None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:20.681419 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11dbc6a-cc4f-44b6-baa9-0bf5961590ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:20.682086 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dbc6a-cc4f-44b6-baa9-0bf5961590ed None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:20.682370 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dbc6a-cc4f-44b6-baa9-0bf5961590ed None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:20.682673 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dbc6a-cc4f-44b6-baa9-0bf5961590ed None admin] PATH_INFO: `/v3/groups/44d7324b48e6462eb6639fdb1dfe882d` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:20.684484 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11dbc6a-cc4f-44b6-baa9-0bf5961590ed None admin] RBAC: Authorizing `identity:get_group(group_id=44d7324b48e6462eb6639fdb1dfe882d)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:20.685980 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11dbc6a-cc4f-44b6-baa9-0bf5961590ed None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:20.688000 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 189/392] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 27 20:13:20 2022] GET /identity/v3/groups/44d7324b48e6462eb6639fdb1dfe882d => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:20.693722 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f5f40-e71b-43e9-8b2c-9cd33513a967 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:20.807174 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f5f40-e71b-43e9-8b2c-9cd33513a967 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:20.835166 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:20.843372 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3de723-f61d-49cf-a0c7-5a760354dd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:20.844097 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3de723-f61d-49cf-a0c7-5a760354dd52 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:20.844379 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3de723-f61d-49cf-a0c7-5a760354dd52 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:20.844657 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3de723-f61d-49cf-a0c7-5a760354dd52 None admin] PATH_INFO: `/v3/projects/d40f8877192d4e139c6e3bd259c38e25` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:20.845972 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3de723-f61d-49cf-a0c7-5a760354dd52 None admin] RBAC: Authorizing `identity:get_project(project_id=d40f8877192d4e139c6e3bd259c38e25)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:20.847579 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3de723-f61d-49cf-a0c7-5a760354dd52 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:20.853515 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 204/393] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:13:20 2022] GET /identity/v3/projects/d40f8877192d4e139c6e3bd259c38e25 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:20.856390 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11dbc6a-cc4f-44b6-baa9-0bf5961590ed None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:20.918849 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:20.969588 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11dbc6a-cc4f-44b6-baa9-0bf5961590ed None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:21.004419 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29904da0-ae1c-4e29-8f91-13b07c40b9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:21.005098 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29904da0-ae1c-4e29-8f91-13b07c40b9ef None admin] REQUEST_METHOD: `PUT` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:21.005378 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29904da0-ae1c-4e29-8f91-13b07c40b9ef None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:21.005651 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29904da0-ae1c-4e29-8f91-13b07c40b9ef None admin] PATH_INFO: `/v3/projects/d40f8877192d4e139c6e3bd259c38e25/groups/44d7324b48e6462eb6639fdb1dfe882d/roles/13a38ce5696549bf95272ffae43798c8` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:21.007648 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29904da0-ae1c-4e29-8f91-13b07c40b9ef None admin] RBAC: Authorizing `identity:create_grant(project_id=d40f8877192d4e139c6e3bd259c38e25, group_id=44d7324b48e6462eb6639fdb1dfe882d, role_id=13a38ce5696549bf95272ffae43798c8)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:21.009694 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29904da0-ae1c-4e29-8f91-13b07c40b9ef None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:21.026184 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 190/394] 10.222.0.83 () {58 vars in 1442 bytes} [Wed Jul 27 20:13:20 2022] PUT /identity/v3/projects/d40f8877192d4e139c6e3bd259c38e25/groups/44d7324b48e6462eb6639fdb1dfe882d/roles/13a38ce5696549bf95272ffae43798c8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:13:21.212088 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105bb2e-9a6b-438b-9f33-0adc0374b3a1 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:21.212569 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105bb2e-9a6b-438b-9f33-0adc0374b3a1 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:21.212846 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105bb2e-9a6b-438b-9f33-0adc0374b3a1 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:21.214419 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 205/395] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:21.220171 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ee008-6974-40d8-9887-42ae3e3ec167 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:21.220459 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ee008-6974-40d8-9887-42ae3e3ec167 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:21.220736 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ee008-6974-40d8-9887-42ae3e3ec167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:21.241722 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-262ee008-6974-40d8-9887-42ae3e3ec167 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:21.242938 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-262ee008-6974-40d8-9887-42ae3e3ec167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:21.316280 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 191/396] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:21.340451 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105bb2e-9a6b-438b-9f33-0adc0374b3a1 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:21.476865 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105bb2e-9a6b-438b-9f33-0adc0374b3a1 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:21.518595 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cb64a-b8e3-41b2-8630-146ebb3f9996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:21.519338 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cb64a-b8e3-41b2-8630-146ebb3f9996 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:21.519619 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cb64a-b8e3-41b2-8630-146ebb3f9996 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:21.519892 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cb64a-b8e3-41b2-8630-146ebb3f9996 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:21.533655 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01cb64a-b8e3-41b2-8630-146ebb3f9996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:21.538931 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-f01cb64a-b8e3-41b2-8630-146ebb3f9996 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:13:21.538931 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:21.538931 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:21.538931 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:21.538931 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:21.538931 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:21.538931 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:21.538931 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:21.538931 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:21.538931 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:21.538931 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:21.538931 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:21.538931 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:21.538931 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:21.538931 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:21.538931 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:21.539828 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:21.539828 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:21.539828 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:21.539828 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:21.539828 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:21.539828 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:21.539828 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:21.539828 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:21.539828 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:21.539828 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:21.539828 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:21.539828 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:21.539828 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:21.539828 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:21.539828 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:21.539828 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:21.541256 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:21.541256 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:21.541256 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:21.541256 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:21.541256 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:21.541256 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:21.541256 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:21.541256 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:21.541256 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:21.541256 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:21.541256 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:13:21.541256 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:21.541256 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 206/397] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:21.546422 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ee008-6974-40d8-9887-42ae3e3ec167 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:21.598771 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:21.690554 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ee008-6974-40d8-9887-42ae3e3ec167 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:21.744291 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97eb49-42ea-4283-8a3a-c994bc016ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:21.744839 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97eb49-42ea-4283-8a3a-c994bc016ce2 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:21.745120 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97eb49-42ea-4283-8a3a-c994bc016ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:21.745396 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97eb49-42ea-4283-8a3a-c994bc016ce2 None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:21.746121 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97eb49-42ea-4283-8a3a-c994bc016ce2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:21.746427 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97eb49-42ea-4283-8a3a-c994bc016ce2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:21.747833 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97eb49-42ea-4283-8a3a-c994bc016ce2 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:21.757113 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 192/398] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:13:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:21.762731 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cb64a-b8e3-41b2-8630-146ebb3f9996 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:21.834551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:21.889413 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cb64a-b8e3-41b2-8630-146ebb3f9996 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:21.896621 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87499e6c-c7c1-4d8c-99f0-b7924949304d None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:21.897174 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87499e6c-c7c1-4d8c-99f0-b7924949304d None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:21.897712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87499e6c-c7c1-4d8c-99f0-b7924949304d None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:21.900063 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 193/399] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:21.907965 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eff66b-ec33-40cf-86fb-19c7d3c57c73 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:21.908511 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eff66b-ec33-40cf-86fb-19c7d3c57c73 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:21.908997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eff66b-ec33-40cf-86fb-19c7d3c57c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:21.928381 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a871503-7dc9-4174-bf7d-dfd820ef9ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:21.929093 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a871503-7dc9-4174-bf7d-dfd820ef9ecd None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:21.929376 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a871503-7dc9-4174-bf7d-dfd820ef9ecd None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:21.929654 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a871503-7dc9-4174-bf7d-dfd820ef9ecd None admin] PATH_INFO: `/v3/groups/44d7324b48e6462eb6639fdb1dfe882d` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:21.934751 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a871503-7dc9-4174-bf7d-dfd820ef9ecd None admin] RBAC: Authorizing `identity:get_group(group_id=44d7324b48e6462eb6639fdb1dfe882d)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:21.934751 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a871503-7dc9-4174-bf7d-dfd820ef9ecd None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:21.935054 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 207/400] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 27 20:13:21 2022] GET /identity/v3/groups/44d7324b48e6462eb6639fdb1dfe882d => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:21.944813 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a871503-7dc9-4174-bf7d-dfd820ef9ecd None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:21.945088 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-f0eff66b-ec33-40cf-86fb-19c7d3c57c73 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:21.947143 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-f0eff66b-ec33-40cf-86fb-19c7d3c57c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:22.062237 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 194/401] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:22.086037 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a871503-7dc9-4174-bf7d-dfd820ef9ecd None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:22.108690 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eff66b-ec33-40cf-86fb-19c7d3c57c73 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:22.111277 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:22.148150 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b82db7-758d-4650-bc94-ef59e8e7508f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:22.148827 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b82db7-758d-4650-bc94-ef59e8e7508f None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:22.149105 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b82db7-758d-4650-bc94-ef59e8e7508f None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:22.149938 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b82db7-758d-4650-bc94-ef59e8e7508f None admin] PATH_INFO: `/v3/projects/79b53610ba784f5e9b4c8b6b96c30024` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:22.151548 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b82db7-758d-4650-bc94-ef59e8e7508f None admin] RBAC: Authorizing `identity:get_project(project_id=79b53610ba784f5e9b4c8b6b96c30024)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:22.154919 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b82db7-758d-4650-bc94-ef59e8e7508f None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:22.157056 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 208/402] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:13:21 2022] GET /identity/v3/projects/79b53610ba784f5e9b4c8b6b96c30024 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:22.165256 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b82db7-758d-4650-bc94-ef59e8e7508f None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:22.191815 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:22.292490 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b82db7-758d-4650-bc94-ef59e8e7508f None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:22.324799 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eff66b-ec33-40cf-86fb-19c7d3c57c73 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:22.334255 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffc81b-de29-43ca-9285-35df7a4b783f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:22.335290 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffc81b-de29-43ca-9285-35df7a4b783f None admin] REQUEST_METHOD: `PUT` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:22.335827 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffc81b-de29-43ca-9285-35df7a4b783f None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:22.336318 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffc81b-de29-43ca-9285-35df7a4b783f None admin] PATH_INFO: `/v3/projects/79b53610ba784f5e9b4c8b6b96c30024/groups/44d7324b48e6462eb6639fdb1dfe882d/roles/13a38ce5696549bf95272ffae43798c8` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:22.338681 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffc81b-de29-43ca-9285-35df7a4b783f None admin] RBAC: Authorizing `identity:create_grant(project_id=79b53610ba784f5e9b4c8b6b96c30024, group_id=44d7324b48e6462eb6639fdb1dfe882d, role_id=13a38ce5696549bf95272ffae43798c8)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:22.340501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffc81b-de29-43ca-9285-35df7a4b783f None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:22.359417 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 209/403] 10.222.0.83 () {58 vars in 1442 bytes} [Wed Jul 27 20:13:22 2022] PUT /identity/v3/projects/79b53610ba784f5e9b4c8b6b96c30024/groups/44d7324b48e6462eb6639fdb1dfe882d/roles/13a38ce5696549bf95272ffae43798c8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:13:22.363132 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccaa248-e632-4432-a5b2-c4d2c85f2f2d None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:22.363132 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccaa248-e632-4432-a5b2-c4d2c85f2f2d None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:22.363132 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccaa248-e632-4432-a5b2-c4d2c85f2f2d None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:22.367472 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 210/404] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:22.371042 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932bf67-c67a-4e66-b29d-784d9c30f7d1 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:22.371348 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932bf67-c67a-4e66-b29d-784d9c30f7d1 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:22.371624 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932bf67-c67a-4e66-b29d-784d9c30f7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:22.393340 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a282492-df61-4f3e-8d13-2085131c5f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:22.394008 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a282492-df61-4f3e-8d13-2085131c5f1a None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:22.394291 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a282492-df61-4f3e-8d13-2085131c5f1a None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:22.394565 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a282492-df61-4f3e-8d13-2085131c5f1a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:22.405699 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-1932bf67-c67a-4e66-b29d-784d9c30f7d1 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:22.406928 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-1932bf67-c67a-4e66-b29d-784d9c30f7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:22.415867 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a282492-df61-4f3e-8d13-2085131c5f1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:22.420927 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-3a282492-df61-4f3e-8d13-2085131c5f1a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 20:13:22.420927 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:22.420927 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:22.420927 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:22.420927 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:22.420927 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:22.420927 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:22.420927 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:22.420927 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:22.420927 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:22.420927 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:22.420927 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:22.420927 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:22.420927 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:22.420927 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:22.420927 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:22.421844 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:22.421844 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:22.421844 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:22.421844 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:22.421844 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:22.421844 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:22.421844 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:22.421844 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:22.421844 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:22.421844 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:22.421844 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:22.421844 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:22.421844 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:22.421844 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:22.421844 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:22.421844 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:22.422645 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:22.422645 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:22.422645 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:22.422645 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:22.422645 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:22.422645 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:22.422645 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:22.422645 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:22.422645 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:22.422645 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:22.422645 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 20:13:22.422645 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:22.422645 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 195/405] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 27 20:13:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:22.433293 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a282492-df61-4f3e-8d13-2085131c5f1a None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:22.503512 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:22.542834 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 211/406] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:22.582515 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:22.585061 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932bf67-c67a-4e66-b29d-784d9c30f7d1 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:22.595248 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a282492-df61-4f3e-8d13-2085131c5f1a None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:22.639535 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdbe84-2478-4ae1-9e92-5c7e24a083ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:22.640543 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdbe84-2478-4ae1-9e92-5c7e24a083ed None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:22.641029 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdbe84-2478-4ae1-9e92-5c7e24a083ed None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:22.641520 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdbe84-2478-4ae1-9e92-5c7e24a083ed None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:22.642434 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabdbe84-2478-4ae1-9e92-5c7e24a083ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:22.643131 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabdbe84-2478-4ae1-9e92-5c7e24a083ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:22.644779 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabdbe84-2478-4ae1-9e92-5c7e24a083ed None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:22.655334 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 196/407] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:13:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:22.680258 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdbe84-2478-4ae1-9e92-5c7e24a083ed None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:22.715174 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932bf67-c67a-4e66-b29d-784d9c30f7d1 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:22.758064 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee562a0-3253-42f6-9427-13ba8cf9739d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:22.758750 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee562a0-3253-42f6-9427-13ba8cf9739d None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:22.759035 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee562a0-3253-42f6-9427-13ba8cf9739d None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:22.759366 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee562a0-3253-42f6-9427-13ba8cf9739d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:22.783935 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee562a0-3253-42f6-9427-13ba8cf9739d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:22.788822 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-6ee562a0-3253-42f6-9427-13ba8cf9739d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:13:22.788822 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:22.788822 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:22.788822 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:22.788822 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:22.788822 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:22.788822 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:22.788822 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:22.788822 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:22.788822 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:22.788822 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:22.788822 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:22.788822 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:22.788822 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:22.788822 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:22.788822 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:22.789683 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:22.789683 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:22.789683 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:22.789683 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:22.789683 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:22.789683 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:22.789683 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:22.789683 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:22.789683 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:22.789683 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:22.789683 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:22.789683 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:22.789683 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:22.789683 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:22.789683 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:22.789683 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:22.791025 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:22.791025 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:22.791025 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:22.791025 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:22.791025 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:22.791025 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:22.791025 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:22.791025 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:22.791025 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:22.791025 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:22.791025 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:13:22.791025 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:22.791025 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 212/408] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 27 20:13:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:13:22.797966 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee562a0-3253-42f6-9427-13ba8cf9739d None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:22.840091 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdbe84-2478-4ae1-9e92-5c7e24a083ed None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:22.883113 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14963a5c-223c-45ed-b064-ade1ec3a87af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:22.883113 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14963a5c-223c-45ed-b064-ade1ec3a87af None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:22.883113 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14963a5c-223c-45ed-b064-ade1ec3a87af None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:22.883113 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14963a5c-223c-45ed-b064-ade1ec3a87af None admin] PATH_INFO: `/v3/groups/44d7324b48e6462eb6639fdb1dfe882d` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:22.888594 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14963a5c-223c-45ed-b064-ade1ec3a87af None admin] RBAC: Authorizing `identity:get_group(group_id=44d7324b48e6462eb6639fdb1dfe882d)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:22.890474 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14963a5c-223c-45ed-b064-ade1ec3a87af None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:22.897222 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 197/409] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 27 20:13:22 2022] GET /identity/v3/groups/44d7324b48e6462eb6639fdb1dfe882d => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:22.902792 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:22.904187 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14963a5c-223c-45ed-b064-ade1ec3a87af None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:22.973523 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee562a0-3253-42f6-9427-13ba8cf9739d None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:22.997511 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:23.017735 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fead3f5-7b33-4355-8dce-f51b5d4d4a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:23.018597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fead3f5-7b33-4355-8dce-f51b5d4d4a0a None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:23.019027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fead3f5-7b33-4355-8dce-f51b5d4d4a0a None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:23.019637 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fead3f5-7b33-4355-8dce-f51b5d4d4a0a None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:23.020590 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fead3f5-7b33-4355-8dce-f51b5d4d4a0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:23.021053 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fead3f5-7b33-4355-8dce-f51b5d4d4a0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:23.022575 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fead3f5-7b33-4355-8dce-f51b5d4d4a0a None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:23.031902 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 213/410] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:23.041726 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fead3f5-7b33-4355-8dce-f51b5d4d4a0a None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:23.108491 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14963a5c-223c-45ed-b064-ade1ec3a87af None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:23.153454 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8019eb1-0757-42d5-9aae-6bb73dd77f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:23.153845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8019eb1-0757-42d5-9aae-6bb73dd77f6d None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:23.154123 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8019eb1-0757-42d5-9aae-6bb73dd77f6d None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:23.154393 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8019eb1-0757-42d5-9aae-6bb73dd77f6d None admin] PATH_INFO: `/v3/projects/79b53610ba784f5e9b4c8b6b96c30024` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:23.159786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8019eb1-0757-42d5-9aae-6bb73dd77f6d None admin] RBAC: Authorizing `identity:get_project(project_id=79b53610ba784f5e9b4c8b6b96c30024)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:23.161241 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8019eb1-0757-42d5-9aae-6bb73dd77f6d None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:23.168141 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 198/411] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:13:22 2022] GET /identity/v3/projects/79b53610ba784f5e9b4c8b6b96c30024 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:23.170219 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8019eb1-0757-42d5-9aae-6bb73dd77f6d None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:23.295552 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:23.306512 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:23.316218 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8019eb1-0757-42d5-9aae-6bb73dd77f6d None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:23.321053 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fead3f5-7b33-4355-8dce-f51b5d4d4a0a None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:23.360335 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cff4b-a13c-4084-97a7-969c76e5f316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:23.360931 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cff4b-a13c-4084-97a7-969c76e5f316 None admin] REQUEST_METHOD: `PUT` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:23.361207 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cff4b-a13c-4084-97a7-969c76e5f316 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:23.361478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cff4b-a13c-4084-97a7-969c76e5f316 None admin] PATH_INFO: `/v3/projects/79b53610ba784f5e9b4c8b6b96c30024/groups/44d7324b48e6462eb6639fdb1dfe882d/roles/b63f862c45f24bd8856021d73b8fa0e2` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:23.366010 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283cff4b-a13c-4084-97a7-969c76e5f316 None admin] RBAC: Authorizing `identity:create_grant(project_id=79b53610ba784f5e9b4c8b6b96c30024, group_id=44d7324b48e6462eb6639fdb1dfe882d, role_id=b63f862c45f24bd8856021d73b8fa0e2)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:23.370602 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283cff4b-a13c-4084-97a7-969c76e5f316 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:23.395406 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 199/412] 10.222.0.83 () {58 vars in 1442 bytes} [Wed Jul 27 20:13:23 2022] PUT /identity/v3/projects/79b53610ba784f5e9b4c8b6b96c30024/groups/44d7324b48e6462eb6639fdb1dfe882d/roles/b63f862c45f24bd8856021d73b8fa0e2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:13:23.397429 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358d0eb-aec6-40c4-9610-8a42b7674e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:23.398178 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358d0eb-aec6-40c4-9610-8a42b7674e3d None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:23.398459 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358d0eb-aec6-40c4-9610-8a42b7674e3d None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:23.398775 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358d0eb-aec6-40c4-9610-8a42b7674e3d None admin] PATH_INFO: `/v3/groups/1da1995c3eda4ae59dae6dda17a84fbd` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:23.400678 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358d0eb-aec6-40c4-9610-8a42b7674e3d None admin] RBAC: Authorizing `identity:get_group(group_id=1da1995c3eda4ae59dae6dda17a84fbd)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:23.402433 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358d0eb-aec6-40c4-9610-8a42b7674e3d None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:23.404618 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 214/413] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 27 20:13:23 2022] GET /identity/v3/groups/1da1995c3eda4ae59dae6dda17a84fbd => generated 229 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:23.416664 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cff4b-a13c-4084-97a7-969c76e5f316 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:23.479230 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d78f0f-d644-4257-9d4f-92e07b9afe0f None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:23.479537 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d78f0f-d644-4257-9d4f-92e07b9afe0f None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:23.479776 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d78f0f-d644-4257-9d4f-92e07b9afe0f None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:23.481387 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 215/414] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:23.490280 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac477abd-a7cf-4565-81e1-f3beb6878cd8 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:23.490925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac477abd-a7cf-4565-81e1-f3beb6878cd8 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:23.491484 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac477abd-a7cf-4565-81e1-f3beb6878cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:23.515440 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-ac477abd-a7cf-4565-81e1-f3beb6878cd8 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:23.517453 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-ac477abd-a7cf-4565-81e1-f3beb6878cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:23.579835 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cff4b-a13c-4084-97a7-969c76e5f316 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:23.623040 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d185c-82a4-4511-826d-344a678adfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:23.623976 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d185c-82a4-4511-826d-344a678adfd3 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:23.624426 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d185c-82a4-4511-826d-344a678adfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:23.624707 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d185c-82a4-4511-826d-344a678adfd3 None admin] PATH_INFO: `/v3/projects/85a972f1c766490294ece49f734d7df0` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:23.626744 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d185c-82a4-4511-826d-344a678adfd3 None admin] RBAC: Authorizing `identity:get_project(project_id=85a972f1c766490294ece49f734d7df0)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:23.628527 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d185c-82a4-4511-826d-344a678adfd3 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:23.631142 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 200/415] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:13:23 2022] GET /identity/v3/projects/85a972f1c766490294ece49f734d7df0 => generated 344 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:23.633411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 216/416] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 20:13:23.640032 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d185c-82a4-4511-826d-344a678adfd3 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:23.660418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac477abd-a7cf-4565-81e1-f3beb6878cd8 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:23.678811 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:23.764327 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d185c-82a4-4511-826d-344a678adfd3 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:23.802059 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06fd1a0-de99-4a23-b036-a88d08c62d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:23.803025 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fd1a0-de99-4a23-b036-a88d08c62d86 None admin] REQUEST_METHOD: `PUT` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:23.803433 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fd1a0-de99-4a23-b036-a88d08c62d86 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:23.803805 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fd1a0-de99-4a23-b036-a88d08c62d86 None admin] PATH_INFO: `/v3/projects/85a972f1c766490294ece49f734d7df0/groups/1da1995c3eda4ae59dae6dda17a84fbd/roles/df8ec36d044b469d8854eba8394eb107` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:23.806736 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06fd1a0-de99-4a23-b036-a88d08c62d86 None admin] RBAC: Authorizing `identity:create_grant(project_id=85a972f1c766490294ece49f734d7df0, group_id=1da1995c3eda4ae59dae6dda17a84fbd, role_id=df8ec36d044b469d8854eba8394eb107)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:23.808771 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06fd1a0-de99-4a23-b036-a88d08c62d86 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:23.828675 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 201/417] 10.222.0.83 () {58 vars in 1442 bytes} [Wed Jul 27 20:13:23 2022] PUT /identity/v3/projects/85a972f1c766490294ece49f734d7df0/groups/1da1995c3eda4ae59dae6dda17a84fbd/roles/df8ec36d044b469d8854eba8394eb107 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:13:23.892444 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:23.896868 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac477abd-a7cf-4565-81e1-f3beb6878cd8 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:23.952377 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8eb85-2693-4328-b2b0-6b259f6d8cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:23.953031 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8eb85-2693-4328-b2b0-6b259f6d8cbe None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:23.953310 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8eb85-2693-4328-b2b0-6b259f6d8cbe None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:23.953584 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8eb85-2693-4328-b2b0-6b259f6d8cbe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:23.969837 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8eb85-2693-4328-b2b0-6b259f6d8cbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:23.974762 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-7ad8eb85-2693-4328-b2b0-6b259f6d8cbe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 20:13:23.974762 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:23.974762 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:23.974762 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:23.974762 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:23.974762 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:23.974762 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:23.974762 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:23.974762 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:23.974762 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:23.974762 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:23.974762 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:23.974762 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:23.974762 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:23.974762 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:23.974762 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:23.975707 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:23.975707 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:23.975707 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:23.975707 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:23.975707 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:23.975707 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:23.975707 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:23.975707 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:23.975707 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:23.975707 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:23.975707 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:23.975707 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:23.975707 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:23.975707 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:23.975707 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:23.975707 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:23.977139 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:23.977139 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:23.977139 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:23.977139 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:23.977139 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:23.977139 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:23.977139 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:23.977139 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:23.977139 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:23.977139 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:23.977139 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 20:13:23.977139 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:23.977139 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 217/418] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 27 20:13:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:13:23.982673 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06fd1a0-de99-4a23-b036-a88d08c62d86 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:24.098893 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:24.113935 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06fd1a0-de99-4a23-b036-a88d08c62d86 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:24.117103 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf1795-0e4c-4f5c-baed-dbc4d8df5e25 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:24.117587 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf1795-0e4c-4f5c-baed-dbc4d8df5e25 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:24.118045 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf1795-0e4c-4f5c-baed-dbc4d8df5e25 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:24.119977 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 218/419] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:24.124984 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a014e-1d3b-4e9a-9cd7-2db84b9c28cd None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:24.125264 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a014e-1d3b-4e9a-9cd7-2db84b9c28cd None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:24.125536 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a014e-1d3b-4e9a-9cd7-2db84b9c28cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:24.146418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-335a014e-1d3b-4e9a-9cd7-2db84b9c28cd None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:24.147651 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-335a014e-1d3b-4e9a-9cd7-2db84b9c28cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:24.153856 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1f961-a5ec-4c5d-930a-53f0f06ed671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:24.154788 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1f961-a5ec-4c5d-930a-53f0f06ed671 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:24.155330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1f961-a5ec-4c5d-930a-53f0f06ed671 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:24.155802 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1f961-a5ec-4c5d-930a-53f0f06ed671 None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:24.156723 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1f961-a5ec-4c5d-930a-53f0f06ed671 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:24.157267 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1f961-a5ec-4c5d-930a-53f0f06ed671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:24.158847 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1f961-a5ec-4c5d-930a-53f0f06ed671 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:24.173622 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 202/420] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:13:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:24.183315 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1f961-a5ec-4c5d-930a-53f0f06ed671 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:24.228048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 219/421] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 20:13:24.252373 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a014e-1d3b-4e9a-9cd7-2db84b9c28cd None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:24.346956 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:24.361776 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a014e-1d3b-4e9a-9cd7-2db84b9c28cd None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:24.400546 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b456ed-4981-4135-b82b-a01cbe4e9df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:24.401448 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b456ed-4981-4135-b82b-a01cbe4e9df8 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:24.401857 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b456ed-4981-4135-b82b-a01cbe4e9df8 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:24.402251 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b456ed-4981-4135-b82b-a01cbe4e9df8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:24.413267 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b456ed-4981-4135-b82b-a01cbe4e9df8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:24.419009 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-36b456ed-4981-4135-b82b-a01cbe4e9df8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:13:24.419009 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:24.419009 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:24.419009 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:24.419009 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:24.419009 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:24.419009 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:24.419009 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:24.419009 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:24.419009 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:24.419009 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:24.419009 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:24.419009 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:24.419009 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:24.419009 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:24.419009 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:24.420070 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:24.420070 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:24.420070 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:24.420070 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:24.420070 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:24.420070 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:24.420070 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:24.420070 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:24.420070 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:24.420070 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:24.420070 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:24.420070 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:24.420070 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:24.420070 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:24.420070 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:24.420070 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:24.421044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:24.421044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:24.421044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:24.421044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:24.421044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:24.421044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:24.421044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:24.421044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:24.421044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:24.421044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:24.421044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:13:24.421044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:24.423393 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 220/422] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:13:24.429034 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b456ed-4981-4135-b82b-a01cbe4e9df8 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:24.461038 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1f961-a5ec-4c5d-930a-53f0f06ed671 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:24.533337 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b456ed-4981-4135-b82b-a01cbe4e9df8 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:24.551769 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77b945-5aeb-4f7c-a975-9c64571144c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:24.552403 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77b945-5aeb-4f7c-a975-9c64571144c6 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:24.552698 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77b945-5aeb-4f7c-a975-9c64571144c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:24.552945 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77b945-5aeb-4f7c-a975-9c64571144c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:24.570082 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6aa77c-0053-4f09-9570-1a0a42b93005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:24.571566 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6aa77c-0053-4f09-9570-1a0a42b93005 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:24.571988 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6aa77c-0053-4f09-9570-1a0a42b93005 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:24.572418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6aa77c-0053-4f09-9570-1a0a42b93005 None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:24.573308 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6aa77c-0053-4f09-9570-1a0a42b93005 None admin] RBAC: Adding query filter params (name=member) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:24.573749 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6aa77c-0053-4f09-9570-1a0a42b93005 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:24.575312 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6aa77c-0053-4f09-9570-1a0a42b93005 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:24.582188 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:24.586116 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 221/423] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:13:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:24.593651 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6aa77c-0053-4f09-9570-1a0a42b93005 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:24.611309 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:24.674831 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77b945-5aeb-4f7c-a975-9c64571144c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:24.676355 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77b945-5aeb-4f7c-a975-9c64571144c6 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:24.715128 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6aa77c-0053-4f09-9570-1a0a42b93005 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:24.753941 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39842307-666c-4547-9d08-bea43b8a2fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:24.754996 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39842307-666c-4547-9d08-bea43b8a2fc2 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:24.755533 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39842307-666c-4547-9d08-bea43b8a2fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:24.756006 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39842307-666c-4547-9d08-bea43b8a2fc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:24.831481 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39842307-666c-4547-9d08-bea43b8a2fc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:24.833456 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39842307-666c-4547-9d08-bea43b8a2fc2 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:24.859506 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:24.874502 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 203/424] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:13:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 692 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 20:13:24.880875 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77b945-5aeb-4f7c-a975-9c64571144c6 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:24.974320 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:25.006122 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 222/425] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:13:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:25.007432 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4517f-2ea8-4fcf-8d1d-abd9d6e0fadf None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:25.007720 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4517f-2ea8-4fcf-8d1d-abd9d6e0fadf None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:25.007997 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4517f-2ea8-4fcf-8d1d-abd9d6e0fadf None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:25.011335 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 223/426] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:25.012104 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4517f-2ea8-4fcf-8d1d-abd9d6e0fadf None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:25.057019 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77b945-5aeb-4f7c-a975-9c64571144c6 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:25.099708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14242be0-6dde-4fa2-be9f-11405193a38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:25.100356 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14242be0-6dde-4fa2-be9f-11405193a38d None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:25.100638 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14242be0-6dde-4fa2-be9f-11405193a38d None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:25.100914 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14242be0-6dde-4fa2-be9f-11405193a38d None admin] PATH_INFO: `/v3/projects/d40f8877192d4e139c6e3bd259c38e25` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:25.103212 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14242be0-6dde-4fa2-be9f-11405193a38d None admin] RBAC: Authorizing `identity:get_project(project_id=d40f8877192d4e139c6e3bd259c38e25)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:25.104838 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14242be0-6dde-4fa2-be9f-11405193a38d None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:25.106565 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 204/427] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:13:24 2022] GET /identity/v3/projects/d40f8877192d4e139c6e3bd259c38e25 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:25.112361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d02b0-8a16-4cd2-9aef-353516536d22 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:25.112651 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d02b0-8a16-4cd2-9aef-353516536d22 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:25.112928 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d02b0-8a16-4cd2-9aef-353516536d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:25.131138 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-161d02b0-8a16-4cd2-9aef-353516536d22 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:25.132374 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-161d02b0-8a16-4cd2-9aef-353516536d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:25.145097 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4517f-2ea8-4fcf-8d1d-abd9d6e0fadf None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:25.156920 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:25.184051 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a225c-4727-4db0-a5fa-c92dc2a5744a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:25.185143 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a225c-4727-4db0-a5fa-c92dc2a5744a None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:25.185622 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a225c-4727-4db0-a5fa-c92dc2a5744a None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:25.186144 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a225c-4727-4db0-a5fa-c92dc2a5744a None admin] PATH_INFO: `/v3/projects/d40f8877192d4e139c6e3bd259c38e25` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:25.187534 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a225c-4727-4db0-a5fa-c92dc2a5744a None admin] RBAC: Authorizing `identity:get_project(project_id=d40f8877192d4e139c6e3bd259c38e25)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:25.189286 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a225c-4727-4db0-a5fa-c92dc2a5744a None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:25.191160 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 224/428] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:13:25 2022] GET /identity/v3/projects/d40f8877192d4e139c6e3bd259c38e25 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:25.192305 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a225c-4727-4db0-a5fa-c92dc2a5744a None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:25.203155 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 205/429] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:25.208014 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d02b0-8a16-4cd2-9aef-353516536d22 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:25.264835 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:25.325889 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a225c-4727-4db0-a5fa-c92dc2a5744a None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:25.334310 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d02b0-8a16-4cd2-9aef-353516536d22 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:25.364663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f5124-6434-40fc-a149-41a6ef951456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:25.366090 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f5124-6434-40fc-a149-41a6ef951456 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:25.366566 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f5124-6434-40fc-a149-41a6ef951456 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:25.367061 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f5124-6434-40fc-a149-41a6ef951456 None admin] PATH_INFO: `/v3/groups/44d7324b48e6462eb6639fdb1dfe882d` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:25.368629 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f5124-6434-40fc-a149-41a6ef951456 None admin] RBAC: Authorizing `identity:get_group(group_id=44d7324b48e6462eb6639fdb1dfe882d)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:25.370289 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f5124-6434-40fc-a149-41a6ef951456 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:25.372439 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 225/430] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 27 20:13:25 2022] GET /identity/v3/groups/44d7324b48e6462eb6639fdb1dfe882d => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:25.372932 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fb1e5-5b06-419f-9059-44edbb29a0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:25.373590 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fb1e5-5b06-419f-9059-44edbb29a0ca None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:25.373880 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fb1e5-5b06-419f-9059-44edbb29a0ca None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:25.374071 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f5124-6434-40fc-a149-41a6ef951456 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:25.374168 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fb1e5-5b06-419f-9059-44edbb29a0ca None admin] PATH_INFO: `/v3/groups/44d7324b48e6462eb6639fdb1dfe882d` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:25.380898 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133fb1e5-5b06-419f-9059-44edbb29a0ca None admin] RBAC: Authorizing `identity:get_group(group_id=44d7324b48e6462eb6639fdb1dfe882d)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:25.382379 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133fb1e5-5b06-419f-9059-44edbb29a0ca None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:25.384805 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 206/431] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 27 20:13:25 2022] GET /identity/v3/groups/44d7324b48e6462eb6639fdb1dfe882d => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:25.385252 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fb1e5-5b06-419f-9059-44edbb29a0ca None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:25.426582 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:25.483409 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f5124-6434-40fc-a149-41a6ef951456 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:25.497803 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fb1e5-5b06-419f-9059-44edbb29a0ca None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:25.509558 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:25.521896 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a112e1-69f7-4cdf-ac63-e2f1b5daa552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:25.522828 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a112e1-69f7-4cdf-ac63-e2f1b5daa552 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:25.523427 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a112e1-69f7-4cdf-ac63-e2f1b5daa552 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:25.524430 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a112e1-69f7-4cdf-ac63-e2f1b5daa552 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:25.535905 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a112e1-69f7-4cdf-ac63-e2f1b5daa552 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:25.536151 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fedec3-0aa8-4e07-be91-59bbf16624e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:25.536716 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fedec3-0aa8-4e07-be91-59bbf16624e8 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:25.537010 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fedec3-0aa8-4e07-be91-59bbf16624e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:25.537289 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fedec3-0aa8-4e07-be91-59bbf16624e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:25.538083 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fedec3-0aa8-4e07-be91-59bbf16624e8 None admin] RBAC: Adding query filter params (group.id=44d7324b48e6462eb6639fdb1dfe882d, role.id=b63f862c45f24bd8856021d73b8fa0e2, scope.project.id=d40f8877192d4e139c6e3bd259c38e25) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:25.538395 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fedec3-0aa8-4e07-be91-59bbf16624e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:25.540407 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fedec3-0aa8-4e07-be91-59bbf16624e8 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:25.543694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-79a112e1-69f7-4cdf-ac63-e2f1b5daa552 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:13:25.543694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:25.543694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:25.543694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:25.543694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:25.543694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:25.543694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:25.543694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:25.543694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:25.543694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:25.543694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:25.543694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:25.543694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:25.543694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:25.543694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:25.543694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:25.544573 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:25.544573 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:25.544573 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:25.544573 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:25.544573 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:25.544573 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:25.544573 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:25.544573 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:25.544573 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:25.544573 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:25.544573 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:25.544573 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:25.544573 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:25.544573 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:25.544573 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:25.544573 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:25.545363 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:25.545363 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:25.545363 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:25.545363 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:25.545363 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:25.545363 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:25.545363 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:25.545363 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:25.545363 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:25.545363 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:25.545363 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 20:13:25.545363 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:25.547650 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 226/433] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:25.548625 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a112e1-69f7-4cdf-ac63-e2f1b5daa552 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:25.552282 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 207/433] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Jul 27 20:13:25 2022] GET /identity/v3/role_assignments?group.id=44d7324b48e6462eb6639fdb1dfe882d&scope.project.id=d40f8877192d4e139c6e3bd259c38e25&role.id=b63f862c45f24bd8856021d73b8fa0e2 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:25.558205 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fedec3-0aa8-4e07-be91-59bbf16624e8 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:25.674228 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a112e1-69f7-4cdf-ac63-e2f1b5daa552 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:25.683400 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:25.714776 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446a370-2a05-4156-9d39-6eff0413e7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:25.715862 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446a370-2a05-4156-9d39-6eff0413e7fb None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:25.716363 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446a370-2a05-4156-9d39-6eff0413e7fb None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:25.716957 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446a370-2a05-4156-9d39-6eff0413e7fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:25.717941 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446a370-2a05-4156-9d39-6eff0413e7fb None admin] RBAC: Adding query filter params (group.id=44d7324b48e6462eb6639fdb1dfe882d, role.id=13a38ce5696549bf95272ffae43798c8, scope.project.id=d40f8877192d4e139c6e3bd259c38e25) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:25.718448 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446a370-2a05-4156-9d39-6eff0413e7fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:25.720221 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446a370-2a05-4156-9d39-6eff0413e7fb None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:25.728094 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 227/434] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Jul 27 20:13:25 2022] GET /identity/v3/role_assignments?group.id=44d7324b48e6462eb6639fdb1dfe882d&scope.project.id=d40f8877192d4e139c6e3bd259c38e25&role.id=13a38ce5696549bf95272ffae43798c8 => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:25.749011 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fedec3-0aa8-4e07-be91-59bbf16624e8 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:25.796985 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9dd7e6-ed26-4183-8b8b-4aa587a40473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:25.797740 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dd7e6-ed26-4183-8b8b-4aa587a40473 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:25.798020 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dd7e6-ed26-4183-8b8b-4aa587a40473 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:25.798289 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dd7e6-ed26-4183-8b8b-4aa587a40473 None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:25.799036 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9dd7e6-ed26-4183-8b8b-4aa587a40473 None admin] RBAC: Adding query filter params (name=member) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:25.799385 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9dd7e6-ed26-4183-8b8b-4aa587a40473 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:25.800827 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9dd7e6-ed26-4183-8b8b-4aa587a40473 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:25.815946 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 208/435] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:13:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:25.821891 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446a370-2a05-4156-9d39-6eff0413e7fb None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:25.985852 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446a370-2a05-4156-9d39-6eff0413e7fb None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:26.034748 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0efa5-5b1c-4498-a2d1-0ac69c43e0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:26.035415 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0efa5-5b1c-4498-a2d1-0ac69c43e0ca None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:26.035701 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0efa5-5b1c-4498-a2d1-0ac69c43e0ca None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:26.035975 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0efa5-5b1c-4498-a2d1-0ac69c43e0ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:26.045010 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2fb85-9a48-4395-a291-4fb12fd2e016 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:26.045619 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2fb85-9a48-4395-a291-4fb12fd2e016 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:26.046087 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2fb85-9a48-4395-a291-4fb12fd2e016 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:26.048552 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 209/436] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 20:13:26.054092 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61eba1b-a0da-4314-b2db-5dea27b76ff9 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:26.054649 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61eba1b-a0da-4314-b2db-5dea27b76ff9 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:26.055246 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61eba1b-a0da-4314-b2db-5dea27b76ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:26.088197 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-b61eba1b-a0da-4314-b2db-5dea27b76ff9 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:26.089388 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-b61eba1b-a0da-4314-b2db-5dea27b76ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:26.089497 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:26.125138 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0efa5-5b1c-4498-a2d1-0ac69c43e0ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:26.126617 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0efa5-5b1c-4498-a2d1-0ac69c43e0ca None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:26.140849 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:26.202168 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 210/437] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:26.226679 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61eba1b-a0da-4314-b2db-5dea27b76ff9 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:26.257157 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 228/438] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:13:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:26.262135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0efa5-5b1c-4498-a2d1-0ac69c43e0ca None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:26.356300 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:26.374454 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61eba1b-a0da-4314-b2db-5dea27b76ff9 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:26.396358 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0efa5-5b1c-4498-a2d1-0ac69c43e0ca None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:26.422074 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7421d-3174-4611-92dc-124a00b56d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:26.423331 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7421d-3174-4611-92dc-124a00b56d27 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:26.423817 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7421d-3174-4611-92dc-124a00b56d27 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:26.424592 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7421d-3174-4611-92dc-124a00b56d27 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:26.437509 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7421d-3174-4611-92dc-124a00b56d27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:26.439099 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44935511-9263-4a6d-b0f3-60096b153cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:26.439834 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44935511-9263-4a6d-b0f3-60096b153cca None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:26.440114 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44935511-9263-4a6d-b0f3-60096b153cca None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:26.440389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44935511-9263-4a6d-b0f3-60096b153cca None admin] PATH_INFO: `/v3/projects/79b53610ba784f5e9b4c8b6b96c30024` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:26.443012 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44935511-9263-4a6d-b0f3-60096b153cca None admin] RBAC: Authorizing `identity:get_project(project_id=79b53610ba784f5e9b4c8b6b96c30024)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:26.444031 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-7bf7421d-3174-4611-92dc-124a00b56d27 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 20:13:26.444031 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:26.444031 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:26.444031 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:26.444031 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:26.444031 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:26.444031 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:26.444031 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:26.444031 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:26.444031 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:26.444031 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:26.444031 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:26.444031 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:26.444031 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:26.444031 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:26.444031 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:26.445011 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:26.445011 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:26.445011 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:26.445011 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:26.445011 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:26.445011 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:26.445011 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:26.445011 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:26.445011 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:26.445011 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:26.445011 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:26.445011 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:26.445011 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:26.445011 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:26.445011 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:26.445011 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:26.446338 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:26.446338 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:26.446338 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:26.446338 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:26.446338 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:26.446338 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:26.446338 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:26.446338 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:26.446338 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:26.446338 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:26.446338 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 20:13:26.446338 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:26.446936 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44935511-9263-4a6d-b0f3-60096b153cca None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:26.447405 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 211/439] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 27 20:13:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:13:26.448445 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 229/440] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:13:26 2022] GET /identity/v3/projects/79b53610ba784f5e9b4c8b6b96c30024 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:26.451790 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7421d-3174-4611-92dc-124a00b56d27 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:26.453465 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44935511-9263-4a6d-b0f3-60096b153cca None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:26.482119 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:26.566752 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7421d-3174-4611-92dc-124a00b56d27 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:26.568688 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44935511-9263-4a6d-b0f3-60096b153cca None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:26.600982 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a04ea6-3d9b-4c0a-8fc1-0a5ed8c21325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:26.601602 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a04ea6-3d9b-4c0a-8fc1-0a5ed8c21325 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:26.601882 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a04ea6-3d9b-4c0a-8fc1-0a5ed8c21325 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:26.602137 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615acc7-53a2-41aa-b9b6-2f85aa620deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:26.602245 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a04ea6-3d9b-4c0a-8fc1-0a5ed8c21325 None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:26.602766 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615acc7-53a2-41aa-b9b6-2f85aa620deb None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:26.602878 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a04ea6-3d9b-4c0a-8fc1-0a5ed8c21325 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:26.603051 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615acc7-53a2-41aa-b9b6-2f85aa620deb None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:26.603219 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a04ea6-3d9b-4c0a-8fc1-0a5ed8c21325 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:26.603355 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615acc7-53a2-41aa-b9b6-2f85aa620deb None admin] PATH_INFO: `/v3/groups/44d7324b48e6462eb6639fdb1dfe882d` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:26.604477 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615acc7-53a2-41aa-b9b6-2f85aa620deb None admin] RBAC: Authorizing `identity:get_group(group_id=44d7324b48e6462eb6639fdb1dfe882d)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:26.604572 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a04ea6-3d9b-4c0a-8fc1-0a5ed8c21325 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:26.605889 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615acc7-53a2-41aa-b9b6-2f85aa620deb None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:26.608466 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 230/441] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 27 20:13:26 2022] GET /identity/v3/groups/44d7324b48e6462eb6639fdb1dfe882d => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:26.610083 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d70892-cd33-4755-8ac7-2c1d81f850ad None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:26.610357 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d70892-cd33-4755-8ac7-2c1d81f850ad None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:26.610746 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d70892-cd33-4755-8ac7-2c1d81f850ad None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:26.616056 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 231/442] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:26.616206 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 212/443] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:13:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:26.616285 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d70892-cd33-4755-8ac7-2c1d81f850ad None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:26.617380 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dcd10-281b-4ced-8d5c-8a1e557d7db7 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:26.617706 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dcd10-281b-4ced-8d5c-8a1e557d7db7 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:26.617985 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dcd10-281b-4ced-8d5c-8a1e557d7db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:26.623155 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:26.636425 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-9d2dcd10-281b-4ced-8d5c-8a1e557d7db7 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:26.637602 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-9d2dcd10-281b-4ced-8d5c-8a1e557d7db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:26.703185 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 213/444] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:26.704284 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dcd10-281b-4ced-8d5c-8a1e557d7db7 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:26.725823 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d70892-cd33-4755-8ac7-2c1d81f850ad None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:26.727385 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:26.758145 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d6afc-c7ab-46bb-bb32-3af418d57851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:26.759294 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d6afc-c7ab-46bb-bb32-3af418d57851 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:26.759569 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d6afc-c7ab-46bb-bb32-3af418d57851 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:26.759837 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d6afc-c7ab-46bb-bb32-3af418d57851 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:26.760603 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d6afc-c7ab-46bb-bb32-3af418d57851 None admin] RBAC: Adding query filter params (group.id=44d7324b48e6462eb6639fdb1dfe882d, role.id=13a38ce5696549bf95272ffae43798c8, scope.project.id=79b53610ba784f5e9b4c8b6b96c30024) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:26.760907 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d6afc-c7ab-46bb-bb32-3af418d57851 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:26.762340 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d6afc-c7ab-46bb-bb32-3af418d57851 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:26.768212 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 232/445] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Jul 27 20:13:26 2022] GET /identity/v3/role_assignments?group.id=44d7324b48e6462eb6639fdb1dfe882d&scope.project.id=79b53610ba784f5e9b4c8b6b96c30024&role.id=13a38ce5696549bf95272ffae43798c8 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:26.769068 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d6afc-c7ab-46bb-bb32-3af418d57851 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:26.821539 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dcd10-281b-4ced-8d5c-8a1e557d7db7 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:26.846257 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:26.862766 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfd5c4-af45-4ca8-ad91-507b89d54f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:26.863468 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfd5c4-af45-4ca8-ad91-507b89d54f63 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:26.863755 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfd5c4-af45-4ca8-ad91-507b89d54f63 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:26.864073 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfd5c4-af45-4ca8-ad91-507b89d54f63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:26.881538 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d6afc-c7ab-46bb-bb32-3af418d57851 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:26.921413 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8c3e3-a1c0-4d7d-a2b0-fd0679483678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:26.922088 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8c3e3-a1c0-4d7d-a2b0-fd0679483678 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:26.922453 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8c3e3-a1c0-4d7d-a2b0-fd0679483678 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:26.922726 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8c3e3-a1c0-4d7d-a2b0-fd0679483678 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:26.935030 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc8c3e3-a1c0-4d7d-a2b0-fd0679483678 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:26.941798 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-5dc8c3e3-a1c0-4d7d-a2b0-fd0679483678 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:13:26.941798 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:26.941798 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:26.941798 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:26.941798 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:26.941798 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:26.941798 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:26.941798 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:26.941798 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:26.941798 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:26.941798 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:26.941798 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:26.941798 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:26.941798 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:26.941798 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:26.941798 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:26.942697 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:26.942697 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:26.942697 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:26.942697 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:26.942697 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:26.942697 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:26.942697 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:26.942697 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:26.942697 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:26.942697 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:26.942697 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:26.942697 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:26.942697 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:26.942697 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:26.942697 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:26.942697 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:26.943732 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:26.943732 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:26.943732 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:26.943732 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:26.943732 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:26.943732 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:26.943732 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:26.943732 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:26.943732 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:26.943732 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:26.943732 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:13:26.943732 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:26.943732 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 233/446] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 27 20:13:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:26.949615 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8c3e3-a1c0-4d7d-a2b0-fd0679483678 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:26.952995 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfd5c4-af45-4ca8-ad91-507b89d54f63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:26.954549 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfd5c4-af45-4ca8-ad91-507b89d54f63 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:26.975357 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:27.081047 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 214/447] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:13:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:27.081885 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfd5c4-af45-4ca8-ad91-507b89d54f63 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:27.088346 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8c3e3-a1c0-4d7d-a2b0-fd0679483678 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:27.122640 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:27.129852 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5cf25-b2b1-4764-a198-7f83b45f6101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:27.130474 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5cf25-b2b1-4764-a198-7f83b45f6101 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:27.130756 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5cf25-b2b1-4764-a198-7f83b45f6101 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:27.131030 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5cf25-b2b1-4764-a198-7f83b45f6101 None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:27.131777 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5cf25-b2b1-4764-a198-7f83b45f6101 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:27.132081 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5cf25-b2b1-4764-a198-7f83b45f6101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:27.134024 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5cf25-b2b1-4764-a198-7f83b45f6101 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:27.144101 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 234/448] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:27.149865 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5cf25-b2b1-4764-a198-7f83b45f6101 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:27.198746 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfd5c4-af45-4ca8-ad91-507b89d54f63 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:27.215359 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:27.232786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928efeb-9823-41ef-8972-2294c9a941ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:27.233419 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928efeb-9823-41ef-8972-2294c9a941ee None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:27.233701 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928efeb-9823-41ef-8972-2294c9a941ee None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:27.233982 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928efeb-9823-41ef-8972-2294c9a941ee None admin] PATH_INFO: `/v3/projects/79b53610ba784f5e9b4c8b6b96c30024` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:27.235168 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928efeb-9823-41ef-8972-2294c9a941ee None admin] RBAC: Authorizing `identity:get_project(project_id=79b53610ba784f5e9b4c8b6b96c30024)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:27.236602 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928efeb-9823-41ef-8972-2294c9a941ee None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:27.238254 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 215/449] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:13:27 2022] GET /identity/v3/projects/79b53610ba784f5e9b4c8b6b96c30024 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:27.244230 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928efeb-9823-41ef-8972-2294c9a941ee None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:27.248866 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5cf25-b2b1-4764-a198-7f83b45f6101 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:27.281540 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0c0e1-6a62-4195-9cd5-20a848862040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:27.282149 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0c0e1-6a62-4195-9cd5-20a848862040 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:27.282427 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0c0e1-6a62-4195-9cd5-20a848862040 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:27.282700 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0c0e1-6a62-4195-9cd5-20a848862040 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:27.342033 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:27.344371 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928efeb-9823-41ef-8972-2294c9a941ee None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:27.351339 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0c0e1-6a62-4195-9cd5-20a848862040 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:27.353350 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0c0e1-6a62-4195-9cd5-20a848862040 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:27.378268 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840d1ac-9ad9-4ec4-8fa5-a8da7bcbcfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:27.378905 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840d1ac-9ad9-4ec4-8fa5-a8da7bcbcfd2 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:27.379222 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840d1ac-9ad9-4ec4-8fa5-a8da7bcbcfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:27.379501 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840d1ac-9ad9-4ec4-8fa5-a8da7bcbcfd2 None admin] PATH_INFO: `/v3/groups/44d7324b48e6462eb6639fdb1dfe882d` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:27.380674 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840d1ac-9ad9-4ec4-8fa5-a8da7bcbcfd2 None admin] RBAC: Authorizing `identity:get_group(group_id=44d7324b48e6462eb6639fdb1dfe882d)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:27.382126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840d1ac-9ad9-4ec4-8fa5-a8da7bcbcfd2 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:27.383776 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 216/450] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 27 20:13:27 2022] GET /identity/v3/groups/44d7324b48e6462eb6639fdb1dfe882d => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:27.389504 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840d1ac-9ad9-4ec4-8fa5-a8da7bcbcfd2 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:27.443630 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:27.451062 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 235/451] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:13:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 20:13:27.456488 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0c0e1-6a62-4195-9cd5-20a848862040 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:27.486925 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840d1ac-9ad9-4ec4-8fa5-a8da7bcbcfd2 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:27.519024 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1646b-5ac2-4655-9a46-3de7658cdd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:27.519657 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1646b-5ac2-4655-9a46-3de7658cdd33 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:27.519940 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1646b-5ac2-4655-9a46-3de7658cdd33 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:27.520211 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1646b-5ac2-4655-9a46-3de7658cdd33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:27.520995 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1646b-5ac2-4655-9a46-3de7658cdd33 None admin] RBAC: Adding query filter params (group.id=44d7324b48e6462eb6639fdb1dfe882d, role.id=b63f862c45f24bd8856021d73b8fa0e2, scope.project.id=79b53610ba784f5e9b4c8b6b96c30024) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:27.521301 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1646b-5ac2-4655-9a46-3de7658cdd33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:27.522735 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1646b-5ac2-4655-9a46-3de7658cdd33 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:27.528766 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 217/452] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Jul 27 20:13:27 2022] GET /identity/v3/role_assignments?group.id=44d7324b48e6462eb6639fdb1dfe882d&scope.project.id=79b53610ba784f5e9b4c8b6b96c30024&role.id=b63f862c45f24bd8856021d73b8fa0e2 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:27.543991 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:27.554253 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0c0e1-6a62-4195-9cd5-20a848862040 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:27.590985 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e1d21-5276-4d23-bc3b-c32ab32c09e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:27.591670 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e1d21-5276-4d23-bc3b-c32ab32c09e3 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:27.591952 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e1d21-5276-4d23-bc3b-c32ab32c09e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:27.592284 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e1d21-5276-4d23-bc3b-c32ab32c09e3 None admin] PATH_INFO: `/v3/projects/85a972f1c766490294ece49f734d7df0` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:27.593452 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e1d21-5276-4d23-bc3b-c32ab32c09e3 None admin] RBAC: Authorizing `identity:get_project(project_id=85a972f1c766490294ece49f734d7df0)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:27.594906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e1d21-5276-4d23-bc3b-c32ab32c09e3 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:27.596641 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 236/453] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 27 20:13:27 2022] GET /identity/v3/projects/85a972f1c766490294ece49f734d7df0 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:27.603102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1646b-5ac2-4655-9a46-3de7658cdd33 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:27.707465 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1646b-5ac2-4655-9a46-3de7658cdd33 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:27.725085 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:27.742755 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1de9b-a63a-422d-8050-a2dcfe0188ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:27.743428 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1de9b-a63a-422d-8050-a2dcfe0188ab None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:27.743709 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1de9b-a63a-422d-8050-a2dcfe0188ab None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:27.743981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1de9b-a63a-422d-8050-a2dcfe0188ab None admin] PATH_INFO: `/v3/groups/1da1995c3eda4ae59dae6dda17a84fbd` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:27.745127 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1de9b-a63a-422d-8050-a2dcfe0188ab None admin] RBAC: Authorizing `identity:get_group(group_id=1da1995c3eda4ae59dae6dda17a84fbd)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:27.746551 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1de9b-a63a-422d-8050-a2dcfe0188ab None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:27.748177 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 218/454] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 27 20:13:27 2022] GET /identity/v3/groups/1da1995c3eda4ae59dae6dda17a84fbd => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:27.754549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e1d21-5276-4d23-bc3b-c32ab32c09e3 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:27.854548 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e1d21-5276-4d23-bc3b-c32ab32c09e3 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:27.889116 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36716df9-e1d5-4c5b-83d2-2611d8282d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:27.889736 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36716df9-e1d5-4c5b-83d2-2611d8282d63 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:27.890022 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36716df9-e1d5-4c5b-83d2-2611d8282d63 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:27.890291 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36716df9-e1d5-4c5b-83d2-2611d8282d63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:27.891090 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36716df9-e1d5-4c5b-83d2-2611d8282d63 None admin] RBAC: Adding query filter params (group.id=1da1995c3eda4ae59dae6dda17a84fbd, role.id=df8ec36d044b469d8854eba8394eb107, scope.project.id=85a972f1c766490294ece49f734d7df0) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:27.891407 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36716df9-e1d5-4c5b-83d2-2611d8282d63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:27.892855 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36716df9-e1d5-4c5b-83d2-2611d8282d63 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:27.898618 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 237/455] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Jul 27 20:13:27 2022] GET /identity/v3/role_assignments?group.id=1da1995c3eda4ae59dae6dda17a84fbd&scope.project.id=85a972f1c766490294ece49f734d7df0&role.id=df8ec36d044b469d8854eba8394eb107 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:30.424658 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fbcf6-e511-4c92-a819-920983422f90 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:30.424658 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fbcf6-e511-4c92-a819-920983422f90 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:30.424658 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fbcf6-e511-4c92-a819-920983422f90 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:30.425609 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 219/456] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:30.432389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfa2e0-ba12-4df6-87d1-7be5c1c291ba None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:30.433330 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfa2e0-ba12-4df6-87d1-7be5c1c291ba None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:30.433809 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfa2e0-ba12-4df6-87d1-7be5c1c291ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:30.453114 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-a2dfa2e0-ba12-4df6-87d1-7be5c1c291ba None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:30.454610 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-a2dfa2e0-ba12-4df6-87d1-7be5c1c291ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:30.473251 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:30.531327 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 238/457] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:30.557281 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fbcf6-e511-4c92-a819-920983422f90 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:30.579320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f3428-2599-4019-8492-0b02703ab04f None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:30.580045 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f3428-2599-4019-8492-0b02703ab04f None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:30.580525 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f3428-2599-4019-8492-0b02703ab04f None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:30.583088 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 239/458] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 20:13:30.588700 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d3b48-1f33-4e40-8af9-8830baafa487 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:30.589218 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d3b48-1f33-4e40-8af9-8830baafa487 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:30.589692 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d3b48-1f33-4e40-8af9-8830baafa487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:30.609511 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-ad5d3b48-1f33-4e40-8af9-8830baafa487 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:30.611142 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-ad5d3b48-1f33-4e40-8af9-8830baafa487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:30.685587 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 240/459] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:30.687288 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c1d23-fce2-4c2a-9724-dfcd62804f75 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:30.687573 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c1d23-fce2-4c2a-9724-dfcd62804f75 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:30.687673 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fbcf6-e511-4c92-a819-920983422f90 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:30.687855 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c1d23-fce2-4c2a-9724-dfcd62804f75 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:30.689277 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 241/460] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:30.694100 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d308a72-3179-4584-8f4d-26e405a48dbe None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:30.694376 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d308a72-3179-4584-8f4d-26e405a48dbe None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:30.694644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d308a72-3179-4584-8f4d-26e405a48dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:30.717279 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-8d308a72-3179-4584-8f4d-26e405a48dbe None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:30.718487 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-8d308a72-3179-4584-8f4d-26e405a48dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:30.730318 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b171bcd-9f99-4726-bab0-13f7115c6a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:30.731097 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b171bcd-9f99-4726-bab0-13f7115c6a1e None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:30.731406 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b171bcd-9f99-4726-bab0-13f7115c6a1e None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:30.731688 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b171bcd-9f99-4726-bab0-13f7115c6a1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:30.742284 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b171bcd-9f99-4726-bab0-13f7115c6a1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:30.743778 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b171bcd-9f99-4726-bab0-13f7115c6a1e None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:30.761302 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-7b171bcd-9f99-4726-bab0-13f7115c6a1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:30.761302 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:30.761302 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:30.761302 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:30.761302 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:30.761302 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:30.761302 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:30.761302 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:30.761302 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:30.761302 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:30.761302 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:30.761302 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:30.761302 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:30.761302 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:30.761302 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:30.762187 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:30.762187 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:30.762187 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:30.762187 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:30.762187 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:30.762187 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:30.762187 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:30.762187 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:30.762187 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:30.762187 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:30.762187 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:30.762187 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:30.762187 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:30.762187 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:30.762187 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:30.762187 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:30.762187 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:30.763022 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:30.763022 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:30.763022 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:30.763022 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:30.763922 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 220/461] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:30.764816 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b171bcd-9f99-4726-bab0-13f7115c6a1e None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:30.793721 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 242/462] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 20:13:30.794880 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d308a72-3179-4584-8f4d-26e405a48dbe None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:30.811879 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:30.817220 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:30.881257 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b171bcd-9f99-4726-bab0-13f7115c6a1e None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:30.915704 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d308a72-3179-4584-8f4d-26e405a48dbe None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:30.918387 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0396a-9deb-4a76-ac63-7efbf0618a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:30.919164 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0396a-9deb-4a76-ac63-7efbf0618a39 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:30.919446 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0396a-9deb-4a76-ac63-7efbf0618a39 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:30.919716 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0396a-9deb-4a76-ac63-7efbf0618a39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:30.929668 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0396a-9deb-4a76-ac63-7efbf0618a39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:30.931157 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0396a-9deb-4a76-ac63-7efbf0618a39 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:30.946249 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-4be0396a-9deb-4a76-ac63-7efbf0618a39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:30.946249 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:30.946249 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:30.946249 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:30.946249 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:30.946249 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:30.946249 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:30.946249 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:30.946249 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:30.946249 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:30.946249 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:30.946249 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:30.946249 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:30.946249 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:30.946249 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:30.947180 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:30.947180 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:30.947180 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:30.947180 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:30.947180 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:30.947180 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:30.947180 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:30.947180 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:30.947180 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:30.947180 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:30.947180 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:30.947180 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:30.947180 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:30.947180 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:30.947180 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:30.947180 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:30.947180 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:30.951611 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:30.951611 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:30.951611 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:30.951611 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:30.951611 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 221/463] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:30.951611 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0396a-9deb-4a76-ac63-7efbf0618a39 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:30.958676 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3877f3d-1d6f-45f4-8a88-ad9750994661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:30.959332 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3877f3d-1d6f-45f4-8a88-ad9750994661 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:30.959620 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3877f3d-1d6f-45f4-8a88-ad9750994661 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:30.959894 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3877f3d-1d6f-45f4-8a88-ad9750994661 None admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:30.960587 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3877f3d-1d6f-45f4-8a88-ad9750994661 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:30.961524 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3877f3d-1d6f-45f4-8a88-ad9750994661 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:30.968219 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3877f3d-1d6f-45f4-8a88-ad9750994661 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:30.985204 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 243/464] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:30.985204 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3877f3d-1d6f-45f4-8a88-ad9750994661 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:31.046603 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:31.056240 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0396a-9deb-4a76-ac63-7efbf0618a39 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:31.058552 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:31.083316 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3877f3d-1d6f-45f4-8a88-ad9750994661 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:31.091214 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46021c-aede-494b-81ec-7ed7747b5e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:31.091851 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46021c-aede-494b-81ec-7ed7747b5e14 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:31.092140 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46021c-aede-494b-81ec-7ed7747b5e14 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:31.092414 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46021c-aede-494b-81ec-7ed7747b5e14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:31.103536 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46021c-aede-494b-81ec-7ed7747b5e14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:31.104993 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46021c-aede-494b-81ec-7ed7747b5e14 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:31.116184 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc4932-df3b-427f-9197-bcdf00e7762b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:31.116795 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc4932-df3b-427f-9197-bcdf00e7762b None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:31.117075 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc4932-df3b-427f-9197-bcdf00e7762b None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:31.117379 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc4932-df3b-427f-9197-bcdf00e7762b None admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:31.118063 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc4932-df3b-427f-9197-bcdf00e7762b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:31.118365 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc4932-df3b-427f-9197-bcdf00e7762b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:31.118660 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-bd46021c-aede-494b-81ec-7ed7747b5e14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:31.118660 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:31.118660 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:31.118660 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:31.118660 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:31.118660 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:31.118660 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:31.118660 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:31.118660 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:31.118660 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:31.118660 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:31.118660 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:31.118660 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:31.118660 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:31.118660 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:31.119499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:31.119499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:31.119499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:31.119499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:31.119499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:31.119499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:31.119499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:31.119499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:31.119499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:31.119499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:31.119499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:31.119499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:31.119499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:31.119499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:31.119499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:31.119499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:31.119499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:31.120352 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:31.120352 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:31.120352 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:31.120352 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:31.120556 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc4932-df3b-427f-9197-bcdf00e7762b None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:31.120630 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 222/465] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:31.120630 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46021c-aede-494b-81ec-7ed7747b5e14 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:31.135926 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 244/466] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:31.137054 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a89e36-02ed-495e-b09b-9e7c5cfd2b1b None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:31.137339 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a89e36-02ed-495e-b09b-9e7c5cfd2b1b None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:31.137609 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a89e36-02ed-495e-b09b-9e7c5cfd2b1b None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:31.138794 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 245/467] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:31.139499 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a89e36-02ed-495e-b09b-9e7c5cfd2b1b None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:31.229338 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46021c-aede-494b-81ec-7ed7747b5e14 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:31.245262 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a89e36-02ed-495e-b09b-9e7c5cfd2b1b None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:31.262046 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34838882-2686-4935-bf0b-0fbb4ed7740d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:31.262663 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34838882-2686-4935-bf0b-0fbb4ed7740d None admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:31.262943 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34838882-2686-4935-bf0b-0fbb4ed7740d None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:31.263255 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34838882-2686-4935-bf0b-0fbb4ed7740d None admin] PATH_INFO: `/v3/users` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:31.263928 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34838882-2686-4935-bf0b-0fbb4ed7740d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:31.265369 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34838882-2686-4935-bf0b-0fbb4ed7740d None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:31.280305 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf4006-8561-44e8-ba82-0b3736d45c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:31.280910 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf4006-8561-44e8-ba82-0b3736d45c29 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:31.281283 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf4006-8561-44e8-ba82-0b3736d45c29 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:31.281454 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:31.281683 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf4006-8561-44e8-ba82-0b3736d45c29 None admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:31.282368 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf4006-8561-44e8-ba82-0b3736d45c29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:31.282661 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf4006-8561-44e8-ba82-0b3736d45c29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:31.284198 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf4006-8561-44e8-ba82-0b3736d45c29 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:31.285626 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:31.286959 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 223/468] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 27 20:13:31 2022] POST /identity/v3/users => generated 246 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:13:31.287747 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34838882-2686-4935-bf0b-0fbb4ed7740d None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:31.297185 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 246/469] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:31.300699 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8111399-5332-4829-9815-683b59c7aa70 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:31.300699 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8111399-5332-4829-9815-683b59c7aa70 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:31.300699 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8111399-5332-4829-9815-683b59c7aa70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:31.324832 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-a8111399-5332-4829-9815-683b59c7aa70 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:31.326211 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-a8111399-5332-4829-9815-683b59c7aa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:31.401637 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 247/470] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:31.402402 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8111399-5332-4829-9815-683b59c7aa70 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:31.435160 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34838882-2686-4935-bf0b-0fbb4ed7740d None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:31.475973 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ed57e-9edb-4687-8d2e-085138655b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:31.476801 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ed57e-9edb-4687-8d2e-085138655b89 None admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:31.477950 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ed57e-9edb-4687-8d2e-085138655b89 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:31.477950 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ed57e-9edb-4687-8d2e-085138655b89 None admin] PATH_INFO: `/v3/users` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:31.478112 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ed57e-9edb-4687-8d2e-085138655b89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:31.479492 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ed57e-9edb-4687-8d2e-085138655b89 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:31.504174 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 224/471] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 27 20:13:31 2022] POST /identity/v3/users => generated 248 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:13:31.505012 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ed57e-9edb-4687-8d2e-085138655b89 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:31.531942 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8111399-5332-4829-9815-683b59c7aa70 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:31.569057 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:31.572975 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:31.587683 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba29861-85f8-4bf3-ad7b-a4df2d13f6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:31.588321 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba29861-85f8-4bf3-ad7b-a4df2d13f6cc None admin] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:31.588597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba29861-85f8-4bf3-ad7b-a4df2d13f6cc None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:31.588864 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba29861-85f8-4bf3-ad7b-a4df2d13f6cc None admin] PATH_INFO: `/v3/users` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:31.589565 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba29861-85f8-4bf3-ad7b-a4df2d13f6cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:31.592309 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba29861-85f8-4bf3-ad7b-a4df2d13f6cc None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:31.625854 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 248/472] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 27 20:13:31 2022] POST /identity/v3/users => generated 248 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:13:31.642858 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ed57e-9edb-4687-8d2e-085138655b89 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:31.684179 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd39865-cd5f-4109-93ba-349f76743c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:31.684790 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd39865-cd5f-4109-93ba-349f76743c2e None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:31.685071 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd39865-cd5f-4109-93ba-349f76743c2e None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:31.685348 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd39865-cd5f-4109-93ba-349f76743c2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:31.699902 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd39865-cd5f-4109-93ba-349f76743c2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:31.701507 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd39865-cd5f-4109-93ba-349f76743c2e None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:31.718966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-5dd39865-cd5f-4109-93ba-349f76743c2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:31.718966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:31.718966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:31.718966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:31.718966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:31.718966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:31.718966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:31.718966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:31.718966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:31.718966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:31.718966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:31.718966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:31.718966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:31.718966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:31.718966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:31.719917 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:31.719917 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:31.719917 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:31.719917 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:31.719917 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:31.719917 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:31.719917 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:31.719917 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:31.719917 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:31.719917 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:31.719917 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:31.719917 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:31.719917 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:31.719917 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:31.719917 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:31.719917 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:31.719917 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:31.720776 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:31.720776 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:31.720776 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:31.720776 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:31.720776 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 225/473] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:31.728689 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba29861-85f8-4bf3-ad7b-a4df2d13f6cc None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:31.841032 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba29861-85f8-4bf3-ad7b-a4df2d13f6cc None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:31.878957 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41fe31-558e-4a47-bb53-eb82d1522f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:31.879832 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41fe31-558e-4a47-bb53-eb82d1522f0c None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:31.880124 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41fe31-558e-4a47-bb53-eb82d1522f0c None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:31.880400 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41fe31-558e-4a47-bb53-eb82d1522f0c None admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:31.881095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41fe31-558e-4a47-bb53-eb82d1522f0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:31.881400 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41fe31-558e-4a47-bb53-eb82d1522f0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:31.882841 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41fe31-558e-4a47-bb53-eb82d1522f0c None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:31.895180 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 249/474] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:31.900786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd39865-cd5f-4109-93ba-349f76743c2e None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:32.013011 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd39865-cd5f-4109-93ba-349f76743c2e None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:32.020354 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:32.048140 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb7f47-0c7c-4695-83c4-244244bd074e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:32.048765 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb7f47-0c7c-4695-83c4-244244bd074e None admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:32.049043 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb7f47-0c7c-4695-83c4-244244bd074e None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:32.049317 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb7f47-0c7c-4695-83c4-244244bd074e None admin] PATH_INFO: `/v3/users` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:32.049992 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb7f47-0c7c-4695-83c4-244244bd074e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:32.051460 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb7f47-0c7c-4695-83c4-244244bd074e None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:32.077155 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 226/475] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 27 20:13:31 2022] POST /identity/v3/users => generated 249 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:13:33.618419 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a3e77-56ee-40b1-b092-8ee5d973a5cc None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:33.618922 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a3e77-56ee-40b1-b092-8ee5d973a5cc None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:33.618922 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a3e77-56ee-40b1-b092-8ee5d973a5cc None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:33.620489 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 250/476] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:33.626175 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6ecc4-9be3-41c0-8b4d-bbeec37a1e6e None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:33.626770 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6ecc4-9be3-41c0-8b4d-bbeec37a1e6e None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:33.627049 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6ecc4-9be3-41c0-8b4d-bbeec37a1e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:33.646387 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-7fb6ecc4-9be3-41c0-8b4d-bbeec37a1e6e None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:33.647600 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-7fb6ecc4-9be3-41c0-8b4d-bbeec37a1e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:33.717506 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 227/477] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 20:13:33.741605 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a3e77-56ee-40b1-b092-8ee5d973a5cc None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:33.786302 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:33.853398 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a3e77-56ee-40b1-b092-8ee5d973a5cc None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:33.888475 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb05c2-2325-43c0-b582-1886f23c1c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:33.889388 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb05c2-2325-43c0-b582-1886f23c1c2c None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:33.889811 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb05c2-2325-43c0-b582-1886f23c1c2c None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:33.890222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb05c2-2325-43c0-b582-1886f23c1c2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:33.906556 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb05c2-2325-43c0-b582-1886f23c1c2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:33.912634 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-34eb05c2-2325-43c0-b582-1886f23c1c2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:13:33.912634 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:33.912634 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:33.912634 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:33.912634 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:33.912634 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:33.912634 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:33.912634 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:33.912634 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:33.912634 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:33.912634 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:33.912634 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:33.912634 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:33.912634 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:33.912634 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:33.912634 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:33.915647 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:33.915647 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:33.915647 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:33.915647 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:33.915647 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:33.915647 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:33.915647 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:33.915647 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:33.915647 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:33.915647 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:33.915647 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:33.915647 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:33.915647 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:33.915647 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:33.915647 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:33.915647 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:33.916574 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:33.916574 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:33.916574 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:33.916574 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:33.916574 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:33.916574 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:33.916574 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:33.916574 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:33.916574 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:33.916574 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:33.916574 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:13:33.916574 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:33.918811 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 251/478] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 27 20:13:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:33.920962 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6ecc4-9be3-41c0-8b4d-bbeec37a1e6e None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:33.968043 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be545347-7874-48dc-92a2-c0ef4743a70b None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:33.968701 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be545347-7874-48dc-92a2-c0ef4743a70b None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:33.969067 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be545347-7874-48dc-92a2-c0ef4743a70b None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:33.971007 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 252/479] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:33.976656 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592e62d-03fc-4ea3-9dfc-4cdf8acf383b None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:33.977238 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592e62d-03fc-4ea3-9dfc-4cdf8acf383b None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:33.977617 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592e62d-03fc-4ea3-9dfc-4cdf8acf383b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:33.999191 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-4592e62d-03fc-4ea3-9dfc-4cdf8acf383b None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:34.001890 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-4592e62d-03fc-4ea3-9dfc-4cdf8acf383b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:34.027926 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:34.036880 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6ecc4-9be3-41c0-8b4d-bbeec37a1e6e None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:34.073581 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44180315-d09d-4660-97e8-5a877df91a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:34.074298 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44180315-d09d-4660-97e8-5a877df91a75 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:34.074647 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44180315-d09d-4660-97e8-5a877df91a75 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:34.075005 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44180315-d09d-4660-97e8-5a877df91a75 None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:34.075812 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44180315-d09d-4660-97e8-5a877df91a75 None admin] RBAC: Adding query filter params (name=service) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:34.076121 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44180315-d09d-4660-97e8-5a877df91a75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:34.076806 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 253/480] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 20:13:34.077895 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdda92-e38e-4656-9543-b412bbf0acb6 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:34.078177 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdda92-e38e-4656-9543-b412bbf0acb6 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:34.078446 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdda92-e38e-4656-9543-b412bbf0acb6 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:34.083118 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 254/481] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:34.083635 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44180315-d09d-4660-97e8-5a877df91a75 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:34.084920 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e85a12-92f9-4fdb-ac84-6308bf07c750 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:34.086246 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e85a12-92f9-4fdb-ac84-6308bf07c750 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:34.086653 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e85a12-92f9-4fdb-ac84-6308bf07c750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:34.098370 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 228/482] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 27 20:13:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:34.099568 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44180315-d09d-4660-97e8-5a877df91a75 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:34.107060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-c9e85a12-92f9-4fdb-ac84-6308bf07c750 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:34.108262 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-c9e85a12-92f9-4fdb-ac84-6308bf07c750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:34.138048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:34.185793 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 255/483] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 20:13:34.186996 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e85a12-92f9-4fdb-ac84-6308bf07c750 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:34.199619 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44180315-d09d-4660-97e8-5a877df91a75 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:34.234514 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446d183-5237-4095-b02b-cc5bf9d0fa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:34.235179 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446d183-5237-4095-b02b-cc5bf9d0fa47 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:34.235462 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446d183-5237-4095-b02b-cc5bf9d0fa47 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:34.235733 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446d183-5237-4095-b02b-cc5bf9d0fa47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:34.246977 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446d183-5237-4095-b02b-cc5bf9d0fa47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:34.248459 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446d183-5237-4095-b02b-cc5bf9d0fa47 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:34.263368 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-8446d183-5237-4095-b02b-cc5bf9d0fa47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:34.263368 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:34.263368 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:34.263368 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:34.263368 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:34.263368 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:34.263368 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:34.263368 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:34.263368 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:34.263368 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:34.263368 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:34.263368 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:34.263368 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:34.263368 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:34.263368 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:34.264257 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:34.264257 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:34.264257 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:34.264257 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:34.264257 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:34.264257 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:34.264257 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:34.264257 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:34.264257 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:34.264257 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:34.264257 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:34.264257 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:34.264257 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:34.264257 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:34.264257 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:34.264257 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:34.264257 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:34.265107 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:34.265107 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:34.265107 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:34.265107 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:34.265107 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 229/484] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:34.269757 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446d183-5237-4095-b02b-cc5bf9d0fa47 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:34.281167 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:34.314443 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e85a12-92f9-4fdb-ac84-6308bf07c750 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:34.353042 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9181e07-a19d-4571-b126-b6f1fe473e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:34.354006 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9181e07-a19d-4571-b126-b6f1fe473e44 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:34.354464 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9181e07-a19d-4571-b126-b6f1fe473e44 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:34.354739 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9181e07-a19d-4571-b126-b6f1fe473e44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:34.365075 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9181e07-a19d-4571-b126-b6f1fe473e44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:34.370669 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-a9181e07-a19d-4571-b126-b6f1fe473e44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:13:34.370669 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:34.370669 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:34.370669 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:34.370669 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:34.370669 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:34.370669 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:34.370669 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:34.370669 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:34.370669 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:34.370669 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:34.370669 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:34.370669 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:34.370669 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:34.370669 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:34.370669 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:34.371614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:34.371614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:34.371614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:34.371614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:34.371614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:34.371614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:34.371614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:34.371614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:34.371614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:34.371614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:34.371614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:34.371614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:34.371614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:34.371614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:34.371614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:34.371614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:34.372420 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:34.372420 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:34.372420 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:34.372420 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:34.372420 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:34.372420 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:34.372420 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:34.372420 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:34.372420 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:34.372420 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:34.372420 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:13:34.372420 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:34.372420 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 256/485] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 27 20:13:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:34.373080 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9181e07-a19d-4571-b126-b6f1fe473e44 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:34.397903 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:34.403188 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446d183-5237-4095-b02b-cc5bf9d0fa47 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:34.437383 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98900102-7f71-4097-8332-0d769521a91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:34.437948 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98900102-7f71-4097-8332-0d769521a91e None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:34.438232 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98900102-7f71-4097-8332-0d769521a91e None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:34.438506 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98900102-7f71-4097-8332-0d769521a91e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:34.449632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98900102-7f71-4097-8332-0d769521a91e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:34.455114 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-98900102-7f71-4097-8332-0d769521a91e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:13:34.455114 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:34.455114 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:34.455114 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:34.455114 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:34.455114 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:34.455114 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:34.455114 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:34.455114 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:34.455114 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:34.455114 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:34.455114 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:34.455114 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:34.455114 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:34.455114 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:34.455114 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:34.456012 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:34.456012 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:34.456012 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:34.456012 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:34.456012 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:34.456012 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:34.456012 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:34.456012 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:34.456012 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:34.456012 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:34.456012 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:34.456012 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:34.456012 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:34.456012 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:34.456012 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:34.456012 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:34.456805 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:34.456805 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:34.456805 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:34.456805 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:34.456805 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:34.456805 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:34.456805 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:34.456805 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:34.456805 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:34.456805 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:34.456805 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:13:34.456805 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:34.456805 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 230/486] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 27 20:13:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:34.457476 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98900102-7f71-4097-8332-0d769521a91e None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:34.487219 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9181e07-a19d-4571-b126-b6f1fe473e44 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:34.520615 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:34.521782 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23361f-3eab-4c13-9d95-4f0075f5cd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:34.522417 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23361f-3eab-4c13-9d95-4f0075f5cd7f None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:34.522748 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23361f-3eab-4c13-9d95-4f0075f5cd7f None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:34.523018 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23361f-3eab-4c13-9d95-4f0075f5cd7f None admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:34.523730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf23361f-3eab-4c13-9d95-4f0075f5cd7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:34.524030 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf23361f-3eab-4c13-9d95-4f0075f5cd7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:34.525387 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf23361f-3eab-4c13-9d95-4f0075f5cd7f None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:34.536433 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 257/487] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:34.537582 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d1957-fda6-42a7-aacd-8191cdf49beb None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:34.537867 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d1957-fda6-42a7-aacd-8191cdf49beb None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:34.538172 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d1957-fda6-42a7-aacd-8191cdf49beb None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:34.539383 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 258/488] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:34.540063 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d1957-fda6-42a7-aacd-8191cdf49beb None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:34.562778 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98900102-7f71-4097-8332-0d769521a91e None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:34.597044 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27372d6-3ea7-4a49-8dae-465a6503a422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:34.597765 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27372d6-3ea7-4a49-8dae-465a6503a422 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:34.598110 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27372d6-3ea7-4a49-8dae-465a6503a422 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:34.598496 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27372d6-3ea7-4a49-8dae-465a6503a422 None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:34.599314 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27372d6-3ea7-4a49-8dae-465a6503a422 None admin] RBAC: Adding query filter params (name=service) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:34.599624 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27372d6-3ea7-4a49-8dae-465a6503a422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:34.601000 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27372d6-3ea7-4a49-8dae-465a6503a422 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:34.608807 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 231/489] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 27 20:13:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:34.609585 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27372d6-3ea7-4a49-8dae-465a6503a422 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:34.621206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:34.642446 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d1957-fda6-42a7-aacd-8191cdf49beb None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:34.676105 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d040312-e38a-4609-8569-0075fee0d6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:34.676740 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d040312-e38a-4609-8569-0075fee0d6a7 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:34.677018 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d040312-e38a-4609-8569-0075fee0d6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:34.677290 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d040312-e38a-4609-8569-0075fee0d6a7 None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:34.677988 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d040312-e38a-4609-8569-0075fee0d6a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:34.678292 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d040312-e38a-4609-8569-0075fee0d6a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:34.680236 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d040312-e38a-4609-8569-0075fee0d6a7 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:34.687963 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 259/490] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 27 20:13:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:34.689031 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b6894-882d-4e0f-9f05-7a22aa846abf None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:34.689313 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b6894-882d-4e0f-9f05-7a22aa846abf None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:34.689585 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b6894-882d-4e0f-9f05-7a22aa846abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:34.707138 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-aa5b6894-882d-4e0f-9f05-7a22aa846abf None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:34.708321 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-aa5b6894-882d-4e0f-9f05-7a22aa846abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:34.715198 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27372d6-3ea7-4a49-8dae-465a6503a422 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:34.740970 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:34.749590 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad74dcf-30b5-4ad2-931b-8700c771215c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:34.750232 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad74dcf-30b5-4ad2-931b-8700c771215c None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:34.750517 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad74dcf-30b5-4ad2-931b-8700c771215c None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:34.750800 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad74dcf-30b5-4ad2-931b-8700c771215c None admin] PATH_INFO: `/v3/users/nova` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:34.758367 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad74dcf-30b5-4ad2-931b-8700c771215c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:34.759846 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad74dcf-30b5-4ad2-931b-8700c771215c None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:34.772478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-aad74dcf-30b5-4ad2-931b-8700c771215c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 20:13:34.772478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:34.772478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:34.772478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:34.772478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:34.772478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:34.772478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:34.772478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:34.772478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:34.772478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:34.772478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:34.772478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:34.772478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 20:13:34.772478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 20:13:34.772478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 20:13:34.772478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 20:13:34.773417 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:34.773417 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:34.773417 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 20:13:34.773417 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:34.773417 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 20:13:34.773417 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:34.773417 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:34.773417 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:34.773417 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:34.773417 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:34.773417 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:34.773417 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:34.773417 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:34.773417 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:34.773417 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:34.773417 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:34.773417 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:34.773417 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:34.783773 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:34.783773 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:34.783773 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 20:13:34.783773 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 20:13:34.783773 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 20:13:34.783773 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 20:13:34.783773 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 20:13:34.783773 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 20:13:34.783773 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 20:13:34.783773 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:34.783773 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 232/491] 10.222.0.83 () {56 vars in 1093 bytes} [Wed Jul 27 20:13:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:34.784401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 260/492] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:34.784473 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad74dcf-30b5-4ad2-931b-8700c771215c None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:34.784619 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b6894-882d-4e0f-9f05-7a22aa846abf None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:34.853086 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:34.881301 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad74dcf-30b5-4ad2-931b-8700c771215c None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:34.883365 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b6894-882d-4e0f-9f05-7a22aa846abf None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:34.914900 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebabe9-2502-4a3a-97ad-788ee52fd8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:34.915575 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebabe9-2502-4a3a-97ad-788ee52fd8e8 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:34.915854 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebabe9-2502-4a3a-97ad-788ee52fd8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:34.916131 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebabe9-2502-4a3a-97ad-788ee52fd8e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:34.917082 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee30bc-7643-4286-9676-91f512645893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:34.917742 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee30bc-7643-4286-9676-91f512645893 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:34.918024 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee30bc-7643-4286-9676-91f512645893 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:34.918294 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee30bc-7643-4286-9676-91f512645893 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:34.926512 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebabe9-2502-4a3a-97ad-788ee52fd8e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:34.928072 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebabe9-2502-4a3a-97ad-788ee52fd8e8 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:34.928556 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee30bc-7643-4286-9676-91f512645893 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:34.930613 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee30bc-7643-4286-9676-91f512645893 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:34.942578 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-73ebabe9-2502-4a3a-97ad-788ee52fd8e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:34.942578 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:34.942578 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:34.942578 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:34.942578 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:34.942578 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:34.942578 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:34.942578 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:34.942578 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:34.942578 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:34.942578 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:34.942578 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:34.942578 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:34.942578 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:34.942578 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:34.943412 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:34.943412 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:34.943412 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:34.943412 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:34.943412 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:34.943412 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:34.943412 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:34.943412 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:34.943412 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:34.943412 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:34.943412 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:34.943412 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:34.943412 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:34.943412 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:34.943412 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:34.943412 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:34.943412 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:34.944274 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:34.944274 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:34.944274 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:34.944274 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:34.944274 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 233/493] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:34.944534 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebabe9-2502-4a3a-97ad-788ee52fd8e8 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:34.945228 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-eaee30bc-7643-4286-9676-91f512645893 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:34.945228 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:34.945228 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:34.945228 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:34.945228 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:34.945228 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:34.945228 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:34.945228 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:34.945228 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:34.945228 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:34.945228 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:34.945228 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:34.945228 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:34.945228 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:34.945228 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:34.946014 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:34.946014 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:34.946014 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:34.946014 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:34.946014 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:34.946014 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:34.946014 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:34.946014 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:34.946014 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:34.946014 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:34.946014 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:34.946014 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:34.946014 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:34.946014 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:34.946014 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:34.946014 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:34.946014 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:34.946844 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:34.946844 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:34.946844 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:34.946844 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:34.950897 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 261/494] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:34.951770 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee30bc-7643-4286-9676-91f512645893 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:34.985366 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:35.043599 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebabe9-2502-4a3a-97ad-788ee52fd8e8 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:35.049398 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee30bc-7643-4286-9676-91f512645893 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:35.072916 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:35.076580 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c429a2-3ec3-4f7e-b5d0-aefa57cbe40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:35.076929 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c429a2-3ec3-4f7e-b5d0-aefa57cbe40f None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:35.077213 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c429a2-3ec3-4f7e-b5d0-aefa57cbe40f None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:35.077483 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c429a2-3ec3-4f7e-b5d0-aefa57cbe40f None admin] PATH_INFO: `/v3/users` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:35.078256 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c429a2-3ec3-4f7e-b5d0-aefa57cbe40f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:35.078562 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c429a2-3ec3-4f7e-b5d0-aefa57cbe40f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:35.080009 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c429a2-3ec3-4f7e-b5d0-aefa57cbe40f None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:35.084062 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bf4d8-63ee-453e-9365-21eb1de57d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:35.084686 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bf4d8-63ee-453e-9365-21eb1de57d15 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:35.084969 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bf4d8-63ee-453e-9365-21eb1de57d15 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:35.085246 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bf4d8-63ee-453e-9365-21eb1de57d15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:35.095664 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7bf4d8-63ee-453e-9365-21eb1de57d15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:35.100981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-7f7bf4d8-63ee-453e-9365-21eb1de57d15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:13:35.100981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:35.100981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:35.100981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:35.100981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:35.100981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:35.100981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:35.100981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:35.100981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:35.100981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:35.100981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:35.100981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:35.100981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:35.100981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:35.100981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:35.100981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:35.102403 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:35.102403 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:35.102403 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:35.102403 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:35.102403 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:35.102403 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:35.102403 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:35.102403 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:35.102403 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:35.102403 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:35.102403 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:35.102403 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:35.102403 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:35.102403 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:35.102403 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:35.102403 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:35.103261 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:35.103261 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:35.103261 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:35.103261 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:35.103261 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:35.103261 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:35.103261 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:35.103261 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:35.103261 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:35.103261 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:35.103261 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:13:35.103261 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:35.103261 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 262/495] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 27 20:13:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:35.103919 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bf4d8-63ee-453e-9365-21eb1de57d15 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:35.119449 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 234/496] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Jul 27 20:13:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:35.119449 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c429a2-3ec3-4f7e-b5d0-aefa57cbe40f None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:35.204053 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bf4d8-63ee-453e-9365-21eb1de57d15 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:35.212525 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:35.216757 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c429a2-3ec3-4f7e-b5d0-aefa57cbe40f None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:35.236105 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a49f8a-63ec-43fb-931b-2471f2385d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:35.236711 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a49f8a-63ec-43fb-931b-2471f2385d67 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:35.236985 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a49f8a-63ec-43fb-931b-2471f2385d67 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:35.237249 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a49f8a-63ec-43fb-931b-2471f2385d67 None admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:35.238011 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a49f8a-63ec-43fb-931b-2471f2385d67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:35.238321 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a49f8a-63ec-43fb-931b-2471f2385d67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:35.239724 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a49f8a-63ec-43fb-931b-2471f2385d67 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:35.250835 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379c0c7-e5e6-43cd-9924-3d88010fbf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:35.251738 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379c0c7-e5e6-43cd-9924-3d88010fbf2c None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:35.251969 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 263/497] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:35.252079 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379c0c7-e5e6-43cd-9924-3d88010fbf2c None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:35.252280 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379c0c7-e5e6-43cd-9924-3d88010fbf2c None admin] PATH_INFO: `/v3/domains` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:35.252743 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a49f8a-63ec-43fb-931b-2471f2385d67 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:35.252962 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379c0c7-e5e6-43cd-9924-3d88010fbf2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:35.253264 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379c0c7-e5e6-43cd-9924-3d88010fbf2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:35.254622 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379c0c7-e5e6-43cd-9924-3d88010fbf2c None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:35.272629 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 235/498] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:35.273516 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379c0c7-e5e6-43cd-9924-3d88010fbf2c None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:35.306689 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:35.379316 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a49f8a-63ec-43fb-931b-2471f2385d67 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:35.379565 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379c0c7-e5e6-43cd-9924-3d88010fbf2c None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:35.414858 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec34175-f803-4d21-97c8-481e6f792927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:35.415514 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec34175-f803-4d21-97c8-481e6f792927 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:35.415799 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec34175-f803-4d21-97c8-481e6f792927 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:35.416074 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec34175-f803-4d21-97c8-481e6f792927 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:35.426102 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698e913-1a2e-410e-9f4b-87da15b78926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:35.426712 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698e913-1a2e-410e-9f4b-87da15b78926 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:35.426985 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698e913-1a2e-410e-9f4b-87da15b78926 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:35.427286 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698e913-1a2e-410e-9f4b-87da15b78926 None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:35.427992 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698e913-1a2e-410e-9f4b-87da15b78926 None admin] RBAC: Adding query filter params (name=service) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:35.428291 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698e913-1a2e-410e-9f4b-87da15b78926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:35.430200 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698e913-1a2e-410e-9f4b-87da15b78926 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:35.437853 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 264/499] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 27 20:13:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:35.438618 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698e913-1a2e-410e-9f4b-87da15b78926 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:35.442634 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:35.484854 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec34175-f803-4d21-97c8-481e6f792927 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:35.486327 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec34175-f803-4d21-97c8-481e6f792927 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:35.540600 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698e913-1a2e-410e-9f4b-87da15b78926 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:35.547127 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:35.574351 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2da1e-cd8b-46b6-9a01-114850886ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:35.574976 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2da1e-cd8b-46b6-9a01-114850886ac4 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:35.575283 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2da1e-cd8b-46b6-9a01-114850886ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:35.575553 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2da1e-cd8b-46b6-9a01-114850886ac4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:35.582705 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2da1e-cd8b-46b6-9a01-114850886ac4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:35.583606 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 236/500] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:13:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:35.584189 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2da1e-cd8b-46b6-9a01-114850886ac4 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:35.584429 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec34175-f803-4d21-97c8-481e6f792927 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:35.600530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-abd2da1e-cd8b-46b6-9a01-114850886ac4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 20:13:35.600530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:35.600530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:35.600530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:35.600530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:35.600530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:35.600530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:35.600530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:35.600530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:35.600530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:35.600530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:35.600530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:35.600530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 20:13:35.600530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 20:13:35.600530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 20:13:35.600530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 20:13:35.602113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:35.602113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:35.602113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 20:13:35.602113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:35.602113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 20:13:35.602113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:35.602113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:35.602113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:35.602113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:35.602113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:35.602113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:35.602113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:35.602113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:35.602113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:35.602113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:35.602113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:35.602113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:35.602113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:35.603065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:35.603065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:35.603065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 20:13:35.603065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 20:13:35.603065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 20:13:35.603065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 20:13:35.603065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 20:13:35.603065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 20:13:35.603065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 20:13:35.603065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:35.603065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 265/501] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:35.603065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2da1e-cd8b-46b6-9a01-114850886ac4 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:35.641065 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:35.682384 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec34175-f803-4d21-97c8-481e6f792927 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:35.701985 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2da1e-cd8b-46b6-9a01-114850886ac4 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:35.721848 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc949e-67b0-456b-8706-29e061880260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:35.722686 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc949e-67b0-456b-8706-29e061880260 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:35.722845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc949e-67b0-456b-8706-29e061880260 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:35.723022 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc949e-67b0-456b-8706-29e061880260 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:35.734085 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc949e-67b0-456b-8706-29e061880260 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:35.735642 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc949e-67b0-456b-8706-29e061880260 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:35.739185 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac72d7-5f3c-4de9-8883-23b4f60d3fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:35.739826 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac72d7-5f3c-4de9-8883-23b4f60d3fd1 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:35.740116 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac72d7-5f3c-4de9-8883-23b4f60d3fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:35.740371 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac72d7-5f3c-4de9-8883-23b4f60d3fd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:35.748024 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-fdfc949e-67b0-456b-8706-29e061880260 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 20:13:35.748024 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:35.748024 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:35.748024 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:35.748024 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:35.748024 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:35.748024 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:35.748024 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:35.748024 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:35.748024 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:35.748024 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:35.748024 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:35.748024 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 20:13:35.748024 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 20:13:35.748024 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 20:13:35.748024 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 20:13:35.748948 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:35.748948 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:35.748948 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 20:13:35.748948 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:35.748948 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 20:13:35.748948 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:35.748948 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:35.748948 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:35.748948 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:35.748948 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:35.748948 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:35.748948 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:35.748948 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:35.748948 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:35.748948 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:35.748948 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:35.748948 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:35.748948 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:35.749870 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:35.749870 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:35.749870 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 20:13:35.749870 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 20:13:35.749870 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 20:13:35.749870 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 20:13:35.749870 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 20:13:35.749870 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 20:13:35.749870 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 20:13:35.749870 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:35.749870 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 237/502] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:35.750438 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc949e-67b0-456b-8706-29e061880260 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:35.755423 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac72d7-5f3c-4de9-8883-23b4f60d3fd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:35.756899 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac72d7-5f3c-4de9-8883-23b4f60d3fd1 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:35.771055 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-39ac72d7-5f3c-4de9-8883-23b4f60d3fd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:35.771055 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:35.771055 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:35.771055 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:35.771055 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:35.771055 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:35.771055 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:35.771055 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:35.771055 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:35.771055 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:35.771055 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:35.771055 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:35.771055 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:35.771055 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:35.771055 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:35.771991 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:35.771991 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:35.771991 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:35.771991 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:35.771991 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:35.771991 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:35.771991 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:35.771991 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:35.771991 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:35.771991 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:35.771991 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:35.771991 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:35.771991 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:35.771991 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:35.771991 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:35.771991 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:35.771991 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:35.772852 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:35.772852 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:35.772852 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:35.772852 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:35.772852 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 266/503] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:35.773365 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac72d7-5f3c-4de9-8883-23b4f60d3fd1 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:35.791728 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:35.858210 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc949e-67b0-456b-8706-29e061880260 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:35.874101 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac72d7-5f3c-4de9-8883-23b4f60d3fd1 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:35.874987 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:35.893403 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8b135-6f95-47d4-ae4a-c46b74090d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:35.894044 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8b135-6f95-47d4-ae4a-c46b74090d59 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:35.894323 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8b135-6f95-47d4-ae4a-c46b74090d59 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:35.894598 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8b135-6f95-47d4-ae4a-c46b74090d59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:35.904921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8b135-6f95-47d4-ae4a-c46b74090d59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:35.906378 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8b135-6f95-47d4-ae4a-c46b74090d59 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:35.908354 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5af0d0-c0f4-4c16-ae33-11f3ae47c279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:35.909099 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5af0d0-c0f4-4c16-ae33-11f3ae47c279 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:35.909382 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5af0d0-c0f4-4c16-ae33-11f3ae47c279 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:35.909684 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5af0d0-c0f4-4c16-ae33-11f3ae47c279 None admin] PATH_INFO: `/v3/users` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:35.910467 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5af0d0-c0f4-4c16-ae33-11f3ae47c279 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:35.910778 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5af0d0-c0f4-4c16-ae33-11f3ae47c279 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:35.912244 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5af0d0-c0f4-4c16-ae33-11f3ae47c279 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:35.921406 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-fed8b135-6f95-47d4-ae4a-c46b74090d59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:35.921406 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:35.921406 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:35.921406 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:35.921406 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:35.921406 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:35.921406 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:35.921406 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:35.921406 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:35.921406 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:35.921406 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:35.921406 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:35.921406 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:35.921406 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:35.921406 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:35.922363 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:35.922363 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:35.922363 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:35.922363 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:35.922363 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:35.922363 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:35.922363 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:35.922363 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:35.922363 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:35.922363 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:35.922363 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:35.922363 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:35.922363 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:35.922363 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:35.922363 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:35.922363 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:35.922363 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:35.923423 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:35.923423 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:35.923423 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:35.923423 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:35.923423 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 238/504] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:35.923423 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8b135-6f95-47d4-ae4a-c46b74090d59 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:35.951389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 267/505] 10.222.0.83 () {56 vars in 1137 bytes} [Wed Jul 27 20:13:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:35.952273 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5af0d0-c0f4-4c16-ae33-11f3ae47c279 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:36.030315 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8b135-6f95-47d4-ae4a-c46b74090d59 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:36.041344 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:36.065246 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5af0d0-c0f4-4c16-ae33-11f3ae47c279 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:36.070310 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f41da0-189a-4dce-b911-1daaa13307ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:36.070927 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f41da0-189a-4dce-b911-1daaa13307ae None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:36.071241 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f41da0-189a-4dce-b911-1daaa13307ae None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:36.071517 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f41da0-189a-4dce-b911-1daaa13307ae None admin] PATH_INFO: `/v3/users` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:36.072414 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f41da0-189a-4dce-b911-1daaa13307ae None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:36.072414 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f41da0-189a-4dce-b911-1daaa13307ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:36.074109 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f41da0-189a-4dce-b911-1daaa13307ae None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:36.091813 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 239/506] 10.222.0.83 () {56 vars in 1137 bytes} [Wed Jul 27 20:13:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:36.092631 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f41da0-189a-4dce-b911-1daaa13307ae None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:36.103331 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ac19d-eef8-4b35-9ff2-3f9b724db623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:36.104321 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ac19d-eef8-4b35-9ff2-3f9b724db623 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:36.104824 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ac19d-eef8-4b35-9ff2-3f9b724db623 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:36.105117 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ac19d-eef8-4b35-9ff2-3f9b724db623 None admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:36.105926 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ac19d-eef8-4b35-9ff2-3f9b724db623 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:36.106467 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ac19d-eef8-4b35-9ff2-3f9b724db623 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:36.108350 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ac19d-eef8-4b35-9ff2-3f9b724db623 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:36.119761 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 268/507] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:36.120237 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:36.125118 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ac19d-eef8-4b35-9ff2-3f9b724db623 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:36.193834 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f41da0-189a-4dce-b911-1daaa13307ae None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:36.229765 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ac19d-eef8-4b35-9ff2-3f9b724db623 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:36.230591 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8cc83-fe9d-4fce-92df-152bea1c7340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:36.231501 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8cc83-fe9d-4fce-92df-152bea1c7340 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:36.231991 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8cc83-fe9d-4fce-92df-152bea1c7340 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:36.232466 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8cc83-fe9d-4fce-92df-152bea1c7340 None admin] PATH_INFO: `/v3/domains` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:36.233619 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8cc83-fe9d-4fce-92df-152bea1c7340 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:36.233937 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8cc83-fe9d-4fce-92df-152bea1c7340 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:36.235892 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8cc83-fe9d-4fce-92df-152bea1c7340 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:36.247547 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 240/508] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:36.248363 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8cc83-fe9d-4fce-92df-152bea1c7340 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:36.267488 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1c882-9c87-4278-93bb-6094e118ac15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:36.268107 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1c882-9c87-4278-93bb-6094e118ac15 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:36.268389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1c882-9c87-4278-93bb-6094e118ac15 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:36.268664 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1c882-9c87-4278-93bb-6094e118ac15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:36.272227 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:36.342504 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1c882-9c87-4278-93bb-6094e118ac15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:36.344085 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1c882-9c87-4278-93bb-6094e118ac15 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:36.350141 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:36.362567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8cc83-fe9d-4fce-92df-152bea1c7340 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:36.395947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16332c1a-7c9b-4a4d-819c-a7837b32a465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:36.396562 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16332c1a-7c9b-4a4d-819c-a7837b32a465 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:36.396842 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16332c1a-7c9b-4a4d-819c-a7837b32a465 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:36.397115 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16332c1a-7c9b-4a4d-819c-a7837b32a465 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:36.446543 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 269/509] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:13:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:36.447425 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1c882-9c87-4278-93bb-6094e118ac15 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:36.472514 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16332c1a-7c9b-4a4d-819c-a7837b32a465 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:36.474088 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16332c1a-7c9b-4a4d-819c-a7837b32a465 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:36.481285 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:36.546470 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1c882-9c87-4278-93bb-6094e118ac15 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:36.565169 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:36.578493 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 241/510] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:13:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:36.579339 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16332c1a-7c9b-4a4d-819c-a7837b32a465 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:36.583972 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e55e2-7b2f-442d-a041-58ea6e19a1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:36.584664 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e55e2-7b2f-442d-a041-58ea6e19a1a3 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:36.584943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e55e2-7b2f-442d-a041-58ea6e19a1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:36.585214 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e55e2-7b2f-442d-a041-58ea6e19a1a3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:36.593027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e55e2-7b2f-442d-a041-58ea6e19a1a3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:36.594478 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e55e2-7b2f-442d-a041-58ea6e19a1a3 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:36.606810 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-a65e55e2-7b2f-442d-a041-58ea6e19a1a3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 20:13:36.606810 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:36.606810 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:36.606810 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:36.606810 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:36.606810 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:36.606810 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:36.606810 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:36.606810 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:36.606810 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:36.606810 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:36.606810 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:36.606810 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 20:13:36.606810 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 20:13:36.606810 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 20:13:36.606810 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 20:13:36.607758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:36.607758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:36.607758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 20:13:36.607758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:36.607758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 20:13:36.607758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:36.607758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:36.607758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:36.607758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:36.607758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:36.607758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:36.607758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:36.607758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:36.607758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:36.607758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:36.607758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:36.607758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:36.607758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:36.613761 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:36.613761 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:36.613761 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 20:13:36.613761 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 20:13:36.613761 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 20:13:36.613761 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 20:13:36.613761 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 20:13:36.613761 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 20:13:36.613761 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 20:13:36.613761 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:36.613761 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 270/511] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 27 20:13:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:36.613761 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e55e2-7b2f-442d-a041-58ea6e19a1a3 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:36.679929 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16332c1a-7c9b-4a4d-819c-a7837b32a465 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:36.708046 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:36.714141 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e55e2-7b2f-442d-a041-58ea6e19a1a3 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:36.715096 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ab3bf-192b-4358-b50f-ebe19f7a004d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:36.715744 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ab3bf-192b-4358-b50f-ebe19f7a004d None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:36.716028 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ab3bf-192b-4358-b50f-ebe19f7a004d None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:36.716305 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ab3bf-192b-4358-b50f-ebe19f7a004d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:36.723109 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ab3bf-192b-4358-b50f-ebe19f7a004d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:36.724330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ab3bf-192b-4358-b50f-ebe19f7a004d None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:36.736680 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-306ab3bf-192b-4358-b50f-ebe19f7a004d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:36.736680 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:36.736680 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:36.736680 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:36.736680 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:36.736680 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:36.736680 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:36.736680 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:36.736680 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:36.736680 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:36.736680 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:36.736680 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:36.736680 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 20:13:36.736680 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 20:13:36.736680 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 20:13:36.737511 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 20:13:36.737511 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:36.737511 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:36.737511 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:36.737511 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:36.737511 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:36.737511 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:36.737511 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:36.737511 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:36.737511 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:36.737511 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:36.737511 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:36.737511 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:36.737511 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:36.737511 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:36.737511 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:36.737511 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:36.738362 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 20:13:36.738362 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 20:13:36.738362 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 20:13:36.738362 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 20:13:36.738362 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 20:13:36.738362 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 20:13:36.738362 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:36.738362 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:36.738362 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 242/512] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:13:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:36.738817 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ab3bf-192b-4358-b50f-ebe19f7a004d None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:36.752136 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e4232-e21c-47da-a6a8-d8dc32d5783c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:36.752770 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e4232-e21c-47da-a6a8-d8dc32d5783c None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:36.753051 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e4232-e21c-47da-a6a8-d8dc32d5783c None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:36.753430 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e4232-e21c-47da-a6a8-d8dc32d5783c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:36.764263 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e4232-e21c-47da-a6a8-d8dc32d5783c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:36.765723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e4232-e21c-47da-a6a8-d8dc32d5783c None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:36.779589 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-1a3e4232-e21c-47da-a6a8-d8dc32d5783c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:36.779589 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:36.779589 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:36.779589 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:36.779589 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:36.779589 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:36.779589 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:36.779589 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:36.779589 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:36.779589 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:36.779589 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:36.779589 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:36.779589 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:36.779589 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:36.779589 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:36.780401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:36.780401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:36.780401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:36.780401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:36.780401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:36.780401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:36.780401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:36.780401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:36.780401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:36.780401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:36.780401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:36.780401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:36.780401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:36.780401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:36.780401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:36.780401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:36.780401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:36.781280 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:36.781280 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:36.781280 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:36.781280 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:36.781280 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 271/513] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:36.781541 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e4232-e21c-47da-a6a8-d8dc32d5783c None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:36.792013 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:36.843402 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ab3bf-192b-4358-b50f-ebe19f7a004d None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:36.876691 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070e5e0-7431-4b3e-a3fd-d637f0344b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:36.877325 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070e5e0-7431-4b3e-a3fd-d637f0344b94 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:36.877604 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070e5e0-7431-4b3e-a3fd-d637f0344b94 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:36.877868 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070e5e0-7431-4b3e-a3fd-d637f0344b94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:36.880438 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e4232-e21c-47da-a6a8-d8dc32d5783c None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:36.888938 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070e5e0-7431-4b3e-a3fd-d637f0344b94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:36.890370 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070e5e0-7431-4b3e-a3fd-d637f0344b94 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:36.904048 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-6070e5e0-7431-4b3e-a3fd-d637f0344b94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:36.904048 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:36.904048 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:36.904048 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:36.904048 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:36.904048 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:36.904048 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:36.904048 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:36.904048 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:36.904048 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:36.904048 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:36.904048 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:36.904048 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:36.904048 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:36.904048 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:36.904903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:36.904903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:36.904903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:36.904903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:36.904903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:36.904903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:36.904903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:36.904903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:36.904903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:36.904903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:36.904903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:36.904903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:36.904903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:36.904903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:36.904903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:36.904903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:36.904903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:36.906008 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:36.906008 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:36.906008 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:36.906008 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:36.906008 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 243/514] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:36.906703 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070e5e0-7431-4b3e-a3fd-d637f0344b94 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:36.918443 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0c3b8-e4a2-4033-ace3-6ae9456ce6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:36.919058 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0c3b8-e4a2-4033-ace3-6ae9456ce6ae None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:36.919368 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0c3b8-e4a2-4033-ace3-6ae9456ce6ae None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:36.919638 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0c3b8-e4a2-4033-ace3-6ae9456ce6ae None admin] PATH_INFO: `/v3/users` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:36.920503 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0c3b8-e4a2-4033-ace3-6ae9456ce6ae None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:36.920817 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0c3b8-e4a2-4033-ace3-6ae9456ce6ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:36.922268 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0c3b8-e4a2-4033-ace3-6ae9456ce6ae None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:36.940078 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 272/515] 10.222.0.83 () {56 vars in 1139 bytes} [Wed Jul 27 20:13:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:36.940871 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0c3b8-e4a2-4033-ace3-6ae9456ce6ae None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:36.948802 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:37.006021 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:37.008793 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070e5e0-7431-4b3e-a3fd-d637f0344b94 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:37.039529 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0c3b8-e4a2-4033-ace3-6ae9456ce6ae None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:37.041480 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c70814-4965-4d3a-a079-6e301f373f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:37.042103 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c70814-4965-4d3a-a079-6e301f373f01 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:37.042393 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c70814-4965-4d3a-a079-6e301f373f01 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:37.042653 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c70814-4965-4d3a-a079-6e301f373f01 None admin] PATH_INFO: `/v3/projects` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:37.043430 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c70814-4965-4d3a-a079-6e301f373f01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:37.043736 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c70814-4965-4d3a-a079-6e301f373f01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:37.045179 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c70814-4965-4d3a-a079-6e301f373f01 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:37.063267 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 244/516] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 27 20:13:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:37.064124 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c70814-4965-4d3a-a079-6e301f373f01 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:37.078059 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06889b22-7664-433b-a3bc-a7ca0009383c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:37.078679 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06889b22-7664-433b-a3bc-a7ca0009383c None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:37.078956 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06889b22-7664-433b-a3bc-a7ca0009383c None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:37.079262 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06889b22-7664-433b-a3bc-a7ca0009383c None admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:37.079946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06889b22-7664-433b-a3bc-a7ca0009383c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:37.080247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06889b22-7664-433b-a3bc-a7ca0009383c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:37.081635 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06889b22-7664-433b-a3bc-a7ca0009383c None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:37.093208 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 273/517] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:37.093895 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06889b22-7664-433b-a3bc-a7ca0009383c None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:37.157894 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:37.165517 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c70814-4965-4d3a-a079-6e301f373f01 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:37.193308 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06889b22-7664-433b-a3bc-a7ca0009383c None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:37.198589 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a2bce-aaa4-4bce-b1ee-ddda8d6e3216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:37.199238 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a2bce-aaa4-4bce-b1ee-ddda8d6e3216 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:37.199524 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a2bce-aaa4-4bce-b1ee-ddda8d6e3216 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:37.199802 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a2bce-aaa4-4bce-b1ee-ddda8d6e3216 None admin] PATH_INFO: `/v3/domains` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:37.200493 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a2bce-aaa4-4bce-b1ee-ddda8d6e3216 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:37.200796 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a2bce-aaa4-4bce-b1ee-ddda8d6e3216 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:37.202164 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a2bce-aaa4-4bce-b1ee-ddda8d6e3216 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:37.213168 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 245/518] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:37.213957 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a2bce-aaa4-4bce-b1ee-ddda8d6e3216 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:37.231271 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64723897-9686-4727-8578-f22c634b3343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:37.231885 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64723897-9686-4727-8578-f22c634b3343 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:37.232168 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64723897-9686-4727-8578-f22c634b3343 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:37.232439 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64723897-9686-4727-8578-f22c634b3343 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:37.236328 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:37.297749 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64723897-9686-4727-8578-f22c634b3343 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:37.299252 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64723897-9686-4727-8578-f22c634b3343 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:37.318969 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a2bce-aaa4-4bce-b1ee-ddda8d6e3216 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:37.352626 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd596f22-78a2-4928-94de-799ebdcf9e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:37.353169 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd596f22-78a2-4928-94de-799ebdcf9e2a None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:37.353443 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd596f22-78a2-4928-94de-799ebdcf9e2a None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:37.353714 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd596f22-78a2-4928-94de-799ebdcf9e2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:37.354488 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd596f22-78a2-4928-94de-799ebdcf9e2a None admin] RBAC: Adding query filter params (role.id=49069056c7b14e319599004c4af25dfb, scope.project.id=75313278ff3747909a57b6f37496d31e, user.id=f68b37524d7245e4b606ad8dd15442ef) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:37.354796 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd596f22-78a2-4928-94de-799ebdcf9e2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:37.356252 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd596f22-78a2-4928-94de-799ebdcf9e2a None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:37.361620 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 246/519] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:13:37 2022] GET /identity/v3/role_assignments?user.id=f68b37524d7245e4b606ad8dd15442ef&scope.project.id=75313278ff3747909a57b6f37496d31e&role.id=49069056c7b14e319599004c4af25dfb => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:37.362443 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd596f22-78a2-4928-94de-799ebdcf9e2a None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:37.369556 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:37.416875 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 274/520] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:13:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:37.416875 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64723897-9686-4727-8578-f22c634b3343 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:37.464663 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:37.483246 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd596f22-78a2-4928-94de-799ebdcf9e2a None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:37.522714 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55c529-22ab-4f0c-99cc-3a48995317fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:37.524079 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55c529-22ab-4f0c-99cc-3a48995317fd None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:37.524353 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55c529-22ab-4f0c-99cc-3a48995317fd None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:37.524987 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55c529-22ab-4f0c-99cc-3a48995317fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:37.532268 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55c529-22ab-4f0c-99cc-3a48995317fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:37.533251 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64723897-9686-4727-8578-f22c634b3343 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:37.533716 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55c529-22ab-4f0c-99cc-3a48995317fd None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:37.547399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-7d55c529-22ab-4f0c-99cc-3a48995317fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:37.547399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:37.547399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:37.547399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:37.547399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:37.547399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:37.547399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:37.547399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:37.547399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:37.547399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:37.547399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:37.547399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:37.547399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 20:13:37.547399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 20:13:37.547399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 20:13:37.548284 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 20:13:37.548284 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:37.548284 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:37.548284 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:37.548284 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:37.548284 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:37.548284 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:37.548284 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:37.548284 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:37.548284 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:37.548284 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:37.548284 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:37.548284 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:37.548284 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:37.548284 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:37.548284 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:37.548284 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:37.549126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 20:13:37.549126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 20:13:37.549126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 20:13:37.549126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 20:13:37.549126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 20:13:37.549126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 20:13:37.549126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:37.549126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:37.549126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 247/521] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:13:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:37.549580 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55c529-22ab-4f0c-99cc-3a48995317fd None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:37.579322 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77c12b-cb03-4ec5-99fa-a733d9974ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:37.580441 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77c12b-cb03-4ec5-99fa-a733d9974ec0 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:37.580791 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77c12b-cb03-4ec5-99fa-a733d9974ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:37.581343 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77c12b-cb03-4ec5-99fa-a733d9974ec0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:37.590429 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77c12b-cb03-4ec5-99fa-a733d9974ec0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:37.592376 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77c12b-cb03-4ec5-99fa-a733d9974ec0 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:37.608560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-4a77c12b-cb03-4ec5-99fa-a733d9974ec0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:37.608560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:37.608560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:37.608560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:37.608560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:37.608560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:37.608560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:37.608560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:37.608560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:37.608560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:37.608560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:37.608560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:37.608560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 20:13:37.608560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 20:13:37.608560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 20:13:37.609410 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 20:13:37.609410 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:37.609410 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:37.609410 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:37.609410 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:37.609410 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:37.609410 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:37.609410 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:37.609410 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:37.609410 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:37.609410 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:37.609410 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:37.609410 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:37.609410 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:37.609410 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:37.609410 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:37.609410 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:37.615588 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 20:13:37.615588 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 20:13:37.615588 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 20:13:37.615588 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 20:13:37.615588 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 20:13:37.615588 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 20:13:37.615588 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:37.615588 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:37.615588 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 275/522] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:13:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:37.615588 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77c12b-cb03-4ec5-99fa-a733d9974ec0 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:37.643719 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:37.656711 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55c529-22ab-4f0c-99cc-3a48995317fd None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:37.692612 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29fd9c-3ddf-4d11-a4b7-b80aa897d881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:37.693259 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29fd9c-3ddf-4d11-a4b7-b80aa897d881 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:37.693543 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29fd9c-3ddf-4d11-a4b7-b80aa897d881 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:37.693815 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29fd9c-3ddf-4d11-a4b7-b80aa897d881 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:37.705010 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29fd9c-3ddf-4d11-a4b7-b80aa897d881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:37.706466 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29fd9c-3ddf-4d11-a4b7-b80aa897d881 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:37.709044 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:37.722430 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-fd29fd9c-3ddf-4d11-a4b7-b80aa897d881 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:37.722430 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:37.722430 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:37.722430 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:37.722430 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:37.722430 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:37.722430 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:37.722430 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:37.722430 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:37.722430 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:37.722430 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:37.722430 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:37.722430 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:37.722430 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:37.722430 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:37.723820 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:37.723820 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:37.723820 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:37.723820 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:37.723820 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:37.723820 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:37.723820 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:37.723820 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:37.723820 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:37.723820 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:37.723820 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:37.723820 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:37.723820 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:37.723820 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:37.723820 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:37.723820 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:37.723820 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:37.724674 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:37.724674 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:37.724674 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:37.724674 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:37.724674 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 248/523] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:37.724674 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29fd9c-3ddf-4d11-a4b7-b80aa897d881 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:37.735114 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77c12b-cb03-4ec5-99fa-a733d9974ec0 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:37.775661 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df5621-c86d-4d32-909b-ed1caa7a6385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:37.776526 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df5621-c86d-4d32-909b-ed1caa7a6385 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:37.776798 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df5621-c86d-4d32-909b-ed1caa7a6385 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:37.777050 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df5621-c86d-4d32-909b-ed1caa7a6385 None admin] PATH_INFO: `/v3/projects` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:37.777915 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df5621-c86d-4d32-909b-ed1caa7a6385 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:37.778234 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df5621-c86d-4d32-909b-ed1caa7a6385 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:37.779737 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df5621-c86d-4d32-909b-ed1caa7a6385 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:37.797923 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 276/524] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 27 20:13:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:37.798576 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df5621-c86d-4d32-909b-ed1caa7a6385 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:37.844041 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29fd9c-3ddf-4d11-a4b7-b80aa897d881 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:37.884146 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c23769-8408-49ea-affb-159b30010ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:37.884843 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c23769-8408-49ea-affb-159b30010ece None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:37.885133 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c23769-8408-49ea-affb-159b30010ece None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:37.885401 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c23769-8408-49ea-affb-159b30010ece None admin] PATH_INFO: `/v3/projects` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:37.885843 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:37.886683 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c23769-8408-49ea-affb-159b30010ece None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:37.886792 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c23769-8408-49ea-affb-159b30010ece None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:37.888334 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c23769-8408-49ea-affb-159b30010ece None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:37.901557 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df5621-c86d-4d32-909b-ed1caa7a6385 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:37.904659 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 249/525] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 27 20:13:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:37.904952 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c23769-8408-49ea-affb-159b30010ece None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:37.959474 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5eddd4-3dbc-4080-b8cb-c05818f47d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:37.961033 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5eddd4-3dbc-4080-b8cb-c05818f47d73 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:37.961892 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5eddd4-3dbc-4080-b8cb-c05818f47d73 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:37.962368 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5eddd4-3dbc-4080-b8cb-c05818f47d73 None admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:37.963758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5eddd4-3dbc-4080-b8cb-c05818f47d73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:37.964354 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5eddd4-3dbc-4080-b8cb-c05818f47d73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:37.966098 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5eddd4-3dbc-4080-b8cb-c05818f47d73 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:37.976487 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:37.982238 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 277/526] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:37.983338 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5eddd4-3dbc-4080-b8cb-c05818f47d73 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:38.044398 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c23769-8408-49ea-affb-159b30010ece None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:38.081754 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c76d4-5976-428b-adfc-5ddd8253cbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:38.082463 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c76d4-5976-428b-adfc-5ddd8253cbf7 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:38.082815 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c76d4-5976-428b-adfc-5ddd8253cbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:38.083206 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c76d4-5976-428b-adfc-5ddd8253cbf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:38.084079 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c76d4-5976-428b-adfc-5ddd8253cbf7 None admin] RBAC: Adding query filter params (role.id=49069056c7b14e319599004c4af25dfb, scope.project.id=75313278ff3747909a57b6f37496d31e, user.id=04dc74146aed49cb98441ea945847379) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:38.084461 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c76d4-5976-428b-adfc-5ddd8253cbf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:38.086015 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c76d4-5976-428b-adfc-5ddd8253cbf7 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:38.092457 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 250/527] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:13:37 2022] GET /identity/v3/role_assignments?user.id=04dc74146aed49cb98441ea945847379&scope.project.id=75313278ff3747909a57b6f37496d31e&role.id=49069056c7b14e319599004c4af25dfb => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:38.095990 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c76d4-5976-428b-adfc-5ddd8253cbf7 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:38.111203 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5eddd4-3dbc-4080-b8cb-c05818f47d73 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:38.162454 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef0e11-3ddd-48b7-9dc3-5953a84b162e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:38.163891 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef0e11-3ddd-48b7-9dc3-5953a84b162e None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:38.164175 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef0e11-3ddd-48b7-9dc3-5953a84b162e None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:38.164452 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef0e11-3ddd-48b7-9dc3-5953a84b162e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:38.165266 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef0e11-3ddd-48b7-9dc3-5953a84b162e None admin] RBAC: Adding query filter params (role.id=49069056c7b14e319599004c4af25dfb, scope.project.id=75313278ff3747909a57b6f37496d31e, user.id=4bf3f75970b342609acb2542913b068d) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:38.165580 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef0e11-3ddd-48b7-9dc3-5953a84b162e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:38.167051 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef0e11-3ddd-48b7-9dc3-5953a84b162e None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:38.175334 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 278/528] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:13:37 2022] GET /identity/v3/role_assignments?user.id=4bf3f75970b342609acb2542913b068d&scope.project.id=75313278ff3747909a57b6f37496d31e&role.id=49069056c7b14e319599004c4af25dfb => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:38.224303 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c76d4-5976-428b-adfc-5ddd8253cbf7 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:38.251448 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:38.270856 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b1b06-031a-4420-8fff-c66ce2df506d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:38.271571 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b1b06-031a-4420-8fff-c66ce2df506d None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:38.271853 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b1b06-031a-4420-8fff-c66ce2df506d None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:38.272126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b1b06-031a-4420-8fff-c66ce2df506d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:38.280399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b1b06-031a-4420-8fff-c66ce2df506d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:38.281905 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b1b06-031a-4420-8fff-c66ce2df506d None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:38.295838 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-447b1b06-031a-4420-8fff-c66ce2df506d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:38.295838 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:38.295838 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:38.295838 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:38.295838 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:38.295838 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:38.295838 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:38.295838 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:38.295838 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:38.295838 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:38.295838 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:38.295838 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:38.295838 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 20:13:38.295838 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 20:13:38.295838 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 20:13:38.296754 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 20:13:38.296754 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:38.296754 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:38.296754 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:38.296754 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:38.296754 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:38.296754 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:38.296754 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:38.296754 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:38.296754 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:38.296754 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:38.296754 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:38.296754 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:38.296754 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:38.296754 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:38.296754 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:38.296754 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:38.298112 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 20:13:38.298112 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 20:13:38.298112 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 20:13:38.298112 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 20:13:38.298112 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 20:13:38.298112 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 20:13:38.298112 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:38.298112 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:38.298112 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 251/529] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:13:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:38.306096 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef0e11-3ddd-48b7-9dc3-5953a84b162e None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:38.330469 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:38.445486 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef0e11-3ddd-48b7-9dc3-5953a84b162e None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:38.481501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582e17a-39a3-4d13-adbe-ff808cdcfb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:38.482462 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582e17a-39a3-4d13-adbe-ff808cdcfb90 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:38.482893 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582e17a-39a3-4d13-adbe-ff808cdcfb90 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:38.483361 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582e17a-39a3-4d13-adbe-ff808cdcfb90 None admin] PATH_INFO: `/v3/projects` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:38.484249 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582e17a-39a3-4d13-adbe-ff808cdcfb90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:38.484724 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582e17a-39a3-4d13-adbe-ff808cdcfb90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:38.486328 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582e17a-39a3-4d13-adbe-ff808cdcfb90 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:38.500143 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 279/530] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 27 20:13:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:38.510367 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b1b06-031a-4420-8fff-c66ce2df506d None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:38.614605 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b1b06-031a-4420-8fff-c66ce2df506d None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:38.652994 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5c1d6-84fe-439d-ab2e-21309c6d7c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:38.653613 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5c1d6-84fe-439d-ab2e-21309c6d7c10 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:38.653893 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5c1d6-84fe-439d-ab2e-21309c6d7c10 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:38.654168 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5c1d6-84fe-439d-ab2e-21309c6d7c10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:38.654958 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5c1d6-84fe-439d-ab2e-21309c6d7c10 None admin] RBAC: Adding query filter params (role.id=49069056c7b14e319599004c4af25dfb, scope.project.id=75313278ff3747909a57b6f37496d31e, user.id=308f029a3e7b46fbaff75a01720c8986) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:38.655297 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5c1d6-84fe-439d-ab2e-21309c6d7c10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:38.656724 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5c1d6-84fe-439d-ab2e-21309c6d7c10 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:38.663908 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 252/531] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:13:38 2022] GET /identity/v3/role_assignments?user.id=308f029a3e7b46fbaff75a01720c8986&scope.project.id=75313278ff3747909a57b6f37496d31e&role.id=49069056c7b14e319599004c4af25dfb => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:39.621271 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af19d2-4b05-4f13-87c8-091f16d78341 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:39.621765 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af19d2-4b05-4f13-87c8-091f16d78341 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:39.621765 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af19d2-4b05-4f13-87c8-091f16d78341 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:39.623320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 280/532] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:39.628843 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ad62b-5c18-4e40-95b2-9d43b0bcd696 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:39.629234 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ad62b-5c18-4e40-95b2-9d43b0bcd696 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:39.629401 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ad62b-5c18-4e40-95b2-9d43b0bcd696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:39.647927 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-507ad62b-5c18-4e40-95b2-9d43b0bcd696 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:39.649108 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-507ad62b-5c18-4e40-95b2-9d43b0bcd696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:39.690949 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:39.719380 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 253/533] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:39.742811 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af19d2-4b05-4f13-87c8-091f16d78341 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:39.816257 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:39.852109 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af19d2-4b05-4f13-87c8-091f16d78341 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:39.888434 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd13e1e-b7b9-42ec-81ba-f9eaf50cc827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:39.888995 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd13e1e-b7b9-42ec-81ba-f9eaf50cc827 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:39.889271 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd13e1e-b7b9-42ec-81ba-f9eaf50cc827 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:39.889539 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd13e1e-b7b9-42ec-81ba-f9eaf50cc827 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:39.900188 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd13e1e-b7b9-42ec-81ba-f9eaf50cc827 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:39.905422 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-0dd13e1e-b7b9-42ec-81ba-f9eaf50cc827 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:13:39.905422 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:39.905422 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:39.905422 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:39.905422 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:39.905422 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:39.905422 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:39.905422 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:39.905422 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:39.905422 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:39.905422 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:39.905422 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:39.905422 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:39.905422 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:39.905422 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:39.905422 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:39.906311 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:39.906311 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:39.906311 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:39.906311 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:39.906311 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:39.906311 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:39.906311 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:39.906311 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:39.906311 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:39.906311 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:39.906311 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:39.906311 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:39.906311 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:39.906311 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:39.906311 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:39.906311 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:39.907157 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:39.907157 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:39.907157 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:39.907157 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:39.907157 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:39.907157 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:39.907157 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:39.907157 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:39.907157 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:39.907157 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:39.907157 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:13:39.907157 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:39.907157 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 281/534] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 27 20:13:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:39.912594 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ad62b-5c18-4e40-95b2-9d43b0bcd696 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:40.015475 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ad62b-5c18-4e40-95b2-9d43b0bcd696 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:40.050947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2ac1c-ce00-4ad9-8a49-9612906af1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:40.051888 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2ac1c-ce00-4ad9-8a49-9612906af1ac None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:40.052346 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2ac1c-ce00-4ad9-8a49-9612906af1ac None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:40.052814 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2ac1c-ce00-4ad9-8a49-9612906af1ac None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:40.053709 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2ac1c-ce00-4ad9-8a49-9612906af1ac None admin] RBAC: Adding query filter params (name=service) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:40.054855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2ac1c-ce00-4ad9-8a49-9612906af1ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:40.056412 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2ac1c-ce00-4ad9-8a49-9612906af1ac None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:40.065280 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 254/535] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 27 20:13:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:40.072194 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd13e1e-b7b9-42ec-81ba-f9eaf50cc827 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:40.175623 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd13e1e-b7b9-42ec-81ba-f9eaf50cc827 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:40.204911 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:40.212675 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c11fe9-a2fc-4ddf-9692-81b76a5cee1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:40.213311 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c11fe9-a2fc-4ddf-9692-81b76a5cee1d None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:40.213585 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c11fe9-a2fc-4ddf-9692-81b76a5cee1d None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:40.213856 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c11fe9-a2fc-4ddf-9692-81b76a5cee1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:40.224293 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c11fe9-a2fc-4ddf-9692-81b76a5cee1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:40.226376 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c11fe9-a2fc-4ddf-9692-81b76a5cee1d None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:40.241179 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-43c11fe9-a2fc-4ddf-9692-81b76a5cee1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:40.241179 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:40.241179 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:40.241179 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:40.241179 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:40.241179 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:40.241179 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:40.241179 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:40.241179 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:40.241179 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:40.241179 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:40.241179 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:40.241179 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:40.241179 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:40.241179 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:40.242600 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:40.242600 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:40.242600 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:40.242600 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:40.242600 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:40.242600 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:40.242600 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:40.242600 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:40.242600 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:40.242600 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:40.242600 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:40.242600 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:40.242600 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:40.242600 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:40.242600 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:40.242600 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:40.242600 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:40.243501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:40.243501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:40.243501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:40.243501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:40.247179 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 282/536] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:40.248899 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2ac1c-ce00-4ad9-8a49-9612906af1ac None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:40.303575 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:40.367862 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2ac1c-ce00-4ad9-8a49-9612906af1ac None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:40.411208 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be8be0-e9c2-491e-907b-d61aa1c71237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:40.412014 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be8be0-e9c2-491e-907b-d61aa1c71237 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:40.412299 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be8be0-e9c2-491e-907b-d61aa1c71237 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:40.412623 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be8be0-e9c2-491e-907b-d61aa1c71237 None admin] PATH_INFO: `/v3/domains` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:40.414316 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be8be0-e9c2-491e-907b-d61aa1c71237 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:40.414677 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be8be0-e9c2-491e-907b-d61aa1c71237 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:40.416184 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be8be0-e9c2-491e-907b-d61aa1c71237 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:40.429862 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 255/537] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:40.435803 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c11fe9-a2fc-4ddf-9692-81b76a5cee1d None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:40.458489 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b2777-eea2-4289-80b5-5de9920cb0ca None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:40.458810 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b2777-eea2-4289-80b5-5de9920cb0ca None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:40.459050 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b2777-eea2-4289-80b5-5de9920cb0ca None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:40.461104 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 256/538] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:40.468768 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200beeba-1d30-4349-bab1-84b3bf8eacca None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:40.469442 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200beeba-1d30-4349-bab1-84b3bf8eacca None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:40.469733 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200beeba-1d30-4349-bab1-84b3bf8eacca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:40.493845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-200beeba-1d30-4349-bab1-84b3bf8eacca None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:40.495040 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-200beeba-1d30-4349-bab1-84b3bf8eacca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:40.550004 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c11fe9-a2fc-4ddf-9692-81b76a5cee1d None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:40.584621 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e527d3e-5f8f-4551-985d-ea760a422041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:40.585869 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e527d3e-5f8f-4551-985d-ea760a422041 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:40.586221 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e527d3e-5f8f-4551-985d-ea760a422041 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:40.586565 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e527d3e-5f8f-4551-985d-ea760a422041 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:40.591268 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 257/539] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:40.591268 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d4cea-42ed-440a-8b7b-56044cdfd9b7 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:40.591268 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d4cea-42ed-440a-8b7b-56044cdfd9b7 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:40.591268 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d4cea-42ed-440a-8b7b-56044cdfd9b7 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:40.591268 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 258/540] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:40.596419 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cda133-6735-439c-bbd8-27b7fd1ede29 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:40.596702 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cda133-6735-439c-bbd8-27b7fd1ede29 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:40.596977 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cda133-6735-439c-bbd8-27b7fd1ede29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:40.599281 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e527d3e-5f8f-4551-985d-ea760a422041 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:40.602657 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e527d3e-5f8f-4551-985d-ea760a422041 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:40.619851 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-1e527d3e-5f8f-4551-985d-ea760a422041 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 20:13:40.619851 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:40.619851 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:40.619851 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:40.619851 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:40.619851 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:40.619851 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:40.619851 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:40.619851 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:40.619851 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:40.619851 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:40.619851 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:40.619851 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 20:13:40.619851 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 20:13:40.619851 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 20:13:40.619851 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 20:13:40.620819 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:40.620819 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:40.620819 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 20:13:40.620819 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:40.620819 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 20:13:40.620819 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:40.620819 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:40.620819 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:40.620819 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:40.620819 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:40.620819 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:40.620819 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:40.620819 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:40.620819 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:40.620819 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:40.620819 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:40.620819 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:40.620819 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:40.622135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:40.622135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:40.622135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 20:13:40.622135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 20:13:40.622135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 20:13:40.622135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 20:13:40.622135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 20:13:40.622135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 20:13:40.622135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 20:13:40.622135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:40.622135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 283/541] 10.222.0.83 () {56 vars in 1093 bytes} [Wed Jul 27 20:13:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:40.622135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e527d3e-5f8f-4551-985d-ea760a422041 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:40.628138 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-e3cda133-6735-439c-bbd8-27b7fd1ede29 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:40.629357 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-e3cda133-6735-439c-bbd8-27b7fd1ede29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:40.653335 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:40.669894 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:40.711209 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 259/542] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 20:13:40.711209 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cda133-6735-439c-bbd8-27b7fd1ede29 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:40.741768 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e527d3e-5f8f-4551-985d-ea760a422041 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:40.778699 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639dd065-ab3d-45ad-b2e1-326c0da0cb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:40.779500 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dd065-ab3d-45ad-b2e1-326c0da0cb3a None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:40.779774 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dd065-ab3d-45ad-b2e1-326c0da0cb3a None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:40.780081 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dd065-ab3d-45ad-b2e1-326c0da0cb3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:40.791375 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639dd065-ab3d-45ad-b2e1-326c0da0cb3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:40.796946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-639dd065-ab3d-45ad-b2e1-326c0da0cb3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:13:40.796946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:40.796946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:40.796946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:40.796946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:40.796946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:40.796946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:40.796946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:40.796946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:40.796946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:40.796946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:40.796946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:40.796946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:40.796946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:40.796946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:40.796946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:40.797845 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:40.797845 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:40.797845 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:40.797845 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:40.797845 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:40.797845 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:40.797845 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:40.797845 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:40.797845 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:40.797845 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:40.797845 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:40.797845 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:40.797845 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:40.797845 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:40.797845 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:40.797845 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:40.798928 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:40.798928 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:40.798928 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:40.798928 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:40.798928 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:40.798928 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:40.798928 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:40.798928 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:40.798928 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:40.798928 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:40.798928 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:13:40.798928 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:40.798928 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 284/543] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 27 20:13:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:40.799855 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639dd065-ab3d-45ad-b2e1-326c0da0cb3a None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:40.830751 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cda133-6735-439c-bbd8-27b7fd1ede29 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:40.871658 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25aad1-96eb-4307-bc16-967943b5e322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:40.872304 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25aad1-96eb-4307-bc16-967943b5e322 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:40.872587 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25aad1-96eb-4307-bc16-967943b5e322 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:40.872861 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25aad1-96eb-4307-bc16-967943b5e322 None admin] PATH_INFO: `/v3/users` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:40.873682 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25aad1-96eb-4307-bc16-967943b5e322 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:40.873992 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25aad1-96eb-4307-bc16-967943b5e322 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:40.875886 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25aad1-96eb-4307-bc16-967943b5e322 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:40.907020 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 260/544] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Jul 27 20:13:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:40.907978 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25aad1-96eb-4307-bc16-967943b5e322 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:40.924618 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:40.930389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639dd065-ab3d-45ad-b2e1-326c0da0cb3a None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:40.931989 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:40.968928 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fa863-571e-47b7-8216-b9e9fa7bab4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:40.969490 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fa863-571e-47b7-8216-b9e9fa7bab4a None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:40.969769 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fa863-571e-47b7-8216-b9e9fa7bab4a None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:40.970041 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fa863-571e-47b7-8216-b9e9fa7bab4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:40.980432 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fa863-571e-47b7-8216-b9e9fa7bab4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:40.985750 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-5b7fa863-571e-47b7-8216-b9e9fa7bab4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:13:40.985750 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:40.985750 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:40.985750 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:40.985750 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:40.985750 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:40.985750 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:40.985750 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:40.985750 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:40.985750 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:40.985750 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:40.985750 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:40.985750 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:40.985750 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:40.985750 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:40.985750 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:40.986663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:40.986663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:40.986663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:40.986663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:40.986663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:40.986663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:40.986663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:40.986663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:40.986663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:40.986663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:40.986663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:40.986663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:40.986663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:40.986663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:40.986663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:40.986663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:40.987730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:40.987730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:40.987730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:40.987730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:40.987730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:40.987730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:40.987730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:40.987730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:40.987730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:40.987730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:40.987730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:13:40.987730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:40.987730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 285/545] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 27 20:13:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:40.987730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fa863-571e-47b7-8216-b9e9fa7bab4a None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:41.028893 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25aad1-96eb-4307-bc16-967943b5e322 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:41.074282 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f81bd4-085c-4adc-b5c8-b6f509800368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:41.075007 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f81bd4-085c-4adc-b5c8-b6f509800368 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:41.075318 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f81bd4-085c-4adc-b5c8-b6f509800368 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:41.075594 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f81bd4-085c-4adc-b5c8-b6f509800368 None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:41.076315 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f81bd4-085c-4adc-b5c8-b6f509800368 None admin] RBAC: Adding query filter params (name=service) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:41.076621 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f81bd4-085c-4adc-b5c8-b6f509800368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:41.077988 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f81bd4-085c-4adc-b5c8-b6f509800368 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:41.089534 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 261/546] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 27 20:13:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:41.090285 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f81bd4-085c-4adc-b5c8-b6f509800368 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:41.110613 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fa863-571e-47b7-8216-b9e9fa7bab4a None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:41.143970 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfba20a-7756-4fb7-a87b-617bd3eebcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:41.144596 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfba20a-7756-4fb7-a87b-617bd3eebcd2 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:41.144879 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfba20a-7756-4fb7-a87b-617bd3eebcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:41.145148 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfba20a-7756-4fb7-a87b-617bd3eebcd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:41.155246 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfba20a-7756-4fb7-a87b-617bd3eebcd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:41.156678 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfba20a-7756-4fb7-a87b-617bd3eebcd2 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:41.166315 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:41.170849 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-2bfba20a-7756-4fb7-a87b-617bd3eebcd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:41.170849 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:41.170849 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:41.170849 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:41.170849 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:41.170849 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:41.170849 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:41.170849 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:41.170849 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:41.170849 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:41.170849 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:41.170849 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:41.170849 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:41.170849 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:41.170849 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:41.171723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:41.171723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:41.171723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:41.171723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:41.171723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:41.171723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:41.171723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:41.171723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:41.171723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:41.171723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:41.171723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:41.171723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:41.171723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:41.171723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:41.171723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:41.171723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:41.171723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:41.177418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:41.177418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:41.177418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:41.177418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:41.177418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 286/547] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:41.177418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4f6de-0da3-4fab-bc66-ce4569710450 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:41.177418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4f6de-0da3-4fab-bc66-ce4569710450 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:41.177418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4f6de-0da3-4fab-bc66-ce4569710450 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:41.177418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 287/548] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:41.177913 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4f6de-0da3-4fab-bc66-ce4569710450 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:41.191572 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:41.198339 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f81bd4-085c-4adc-b5c8-b6f509800368 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:41.230750 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64886502-1982-40d1-8ddf-fe1f437ef03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:41.231324 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64886502-1982-40d1-8ddf-fe1f437ef03a None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:41.231600 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64886502-1982-40d1-8ddf-fe1f437ef03a None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:41.231870 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64886502-1982-40d1-8ddf-fe1f437ef03a None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:41.232567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64886502-1982-40d1-8ddf-fe1f437ef03a None admin] RBAC: Adding query filter params (name=service) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:41.232872 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64886502-1982-40d1-8ddf-fe1f437ef03a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:41.234217 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64886502-1982-40d1-8ddf-fe1f437ef03a None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:41.242375 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 262/549] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 27 20:13:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:41.243345 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64886502-1982-40d1-8ddf-fe1f437ef03a None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:41.277109 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4f6de-0da3-4fab-bc66-ce4569710450 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:41.315933 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83898b7-67f7-4e4d-bc3a-638bb0bbe65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:41.316572 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83898b7-67f7-4e4d-bc3a-638bb0bbe65b None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:41.316847 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83898b7-67f7-4e4d-bc3a-638bb0bbe65b None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:41.317117 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83898b7-67f7-4e4d-bc3a-638bb0bbe65b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:41.328382 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83898b7-67f7-4e4d-bc3a-638bb0bbe65b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:41.329820 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83898b7-67f7-4e4d-bc3a-638bb0bbe65b None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:41.343810 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64886502-1982-40d1-8ddf-fe1f437ef03a None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:41.344175 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-f83898b7-67f7-4e4d-bc3a-638bb0bbe65b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:41.344175 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:41.344175 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:41.344175 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:41.344175 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:41.344175 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:41.344175 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:41.344175 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:41.344175 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:41.344175 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:41.344175 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:41.344175 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:41.344175 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:41.344175 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:41.344175 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:41.345162 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:41.345162 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:41.345162 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:41.345162 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:41.345162 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:41.345162 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:41.345162 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:41.345162 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:41.345162 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:41.345162 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:41.345162 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:41.345162 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:41.345162 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:41.345162 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:41.345162 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:41.345162 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:41.345162 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:41.346167 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:41.346167 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:41.346167 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:41.346167 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:41.346167 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 288/550] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:41.346747 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbe271-92bc-4cbf-8687-31dc46dac157 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:41.347032 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbe271-92bc-4cbf-8687-31dc46dac157 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:41.347325 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbe271-92bc-4cbf-8687-31dc46dac157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:41.370733 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-43dbe271-92bc-4cbf-8687-31dc46dac157 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:41.371996 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-43dbe271-92bc-4cbf-8687-31dc46dac157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:41.386109 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db2dca-4af6-40b8-a310-b81add9ff4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:41.386732 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db2dca-4af6-40b8-a310-b81add9ff4aa None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:41.387008 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db2dca-4af6-40b8-a310-b81add9ff4aa None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:41.387611 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db2dca-4af6-40b8-a310-b81add9ff4aa None admin] PATH_INFO: `/v3/domains` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:41.388006 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db2dca-4af6-40b8-a310-b81add9ff4aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:41.388319 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db2dca-4af6-40b8-a310-b81add9ff4aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:41.389684 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db2dca-4af6-40b8-a310-b81add9ff4aa None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:41.397429 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:41.403117 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 263/551] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:41.403711 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db2dca-4af6-40b8-a310-b81add9ff4aa None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:41.436675 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:41.445079 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 289/552] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:41.445889 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbe271-92bc-4cbf-8687-31dc46dac157 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:41.509249 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db2dca-4af6-40b8-a310-b81add9ff4aa None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:41.541788 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d3944-d228-478e-a569-070365464a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:41.542427 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d3944-d228-478e-a569-070365464a35 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:41.542704 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d3944-d228-478e-a569-070365464a35 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:41.542974 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d3944-d228-478e-a569-070365464a35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:41.545024 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbe271-92bc-4cbf-8687-31dc46dac157 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:41.552662 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d3944-d228-478e-a569-070365464a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:41.554659 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d3944-d228-478e-a569-070365464a35 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:41.568914 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-9a5d3944-d228-478e-a569-070365464a35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:41.568914 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:41.568914 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:41.568914 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:41.568914 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:41.568914 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:41.568914 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:41.568914 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:41.568914 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:41.568914 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:41.568914 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:41.568914 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:41.568914 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:41.568914 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:41.568914 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:41.570041 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:41.570041 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:41.570041 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:41.570041 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:41.570041 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:41.570041 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:41.570041 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:41.570041 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:41.570041 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:41.570041 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:41.570041 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:41.570041 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:41.570041 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:41.570041 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:41.570041 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:41.570041 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:41.570041 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:41.571162 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:41.571162 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:41.571162 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:41.571162 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:41.571162 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 264/553] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:41.571162 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d3944-d228-478e-a569-070365464a35 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:41.580098 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46e551-421a-45bd-8639-e3e9c942bbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:41.580725 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46e551-421a-45bd-8639-e3e9c942bbf1 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:41.581007 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46e551-421a-45bd-8639-e3e9c942bbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:41.581281 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46e551-421a-45bd-8639-e3e9c942bbf1 None admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:41.581970 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46e551-421a-45bd-8639-e3e9c942bbf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:41.582278 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46e551-421a-45bd-8639-e3e9c942bbf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:41.583717 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46e551-421a-45bd-8639-e3e9c942bbf1 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:41.594668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 290/554] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:41.595477 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46e551-421a-45bd-8639-e3e9c942bbf1 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:41.626496 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:41.653746 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:41.679521 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d3944-d228-478e-a569-070365464a35 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:41.702930 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46e551-421a-45bd-8639-e3e9c942bbf1 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:41.714159 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d9cb9-5a50-4a63-8ead-34a9b58a1797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:41.714800 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d9cb9-5a50-4a63-8ead-34a9b58a1797 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:41.715099 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d9cb9-5a50-4a63-8ead-34a9b58a1797 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:41.715422 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d9cb9-5a50-4a63-8ead-34a9b58a1797 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:41.721995 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d9cb9-5a50-4a63-8ead-34a9b58a1797 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:41.723469 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d9cb9-5a50-4a63-8ead-34a9b58a1797 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:41.734997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-825d9cb9-5a50-4a63-8ead-34a9b58a1797 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:41.734997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:41.734997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:41.734997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:41.734997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:41.734997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:41.734997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:41.734997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:41.734997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:41.734997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:41.734997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:41.734997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:41.734997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 20:13:41.734997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 20:13:41.734997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 20:13:41.736001 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 20:13:41.736001 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:41.736001 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:41.736001 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:41.736001 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:41.736001 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:41.736001 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:41.736001 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:41.736001 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:41.736001 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:41.736001 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:41.736001 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:41.736001 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:41.736001 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:41.736001 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:41.736001 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:41.736001 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:41.736871 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 20:13:41.736871 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 20:13:41.736871 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 20:13:41.736871 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 20:13:41.736871 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 20:13:41.736871 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 20:13:41.736871 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:41.736871 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:41.736871 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 265/555] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:13:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:41.737353 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d9cb9-5a50-4a63-8ead-34a9b58a1797 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:41.742988 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6f248-59f4-49fb-8a7c-3f46114689bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:41.743658 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6f248-59f4-49fb-8a7c-3f46114689bb None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:41.743932 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6f248-59f4-49fb-8a7c-3f46114689bb None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:41.744197 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6f248-59f4-49fb-8a7c-3f46114689bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:41.754567 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6f248-59f4-49fb-8a7c-3f46114689bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:41.760501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-56a6f248-59f4-49fb-8a7c-3f46114689bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:13:41.760501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:41.760501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:41.760501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:41.760501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:41.760501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:41.760501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:41.760501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:41.760501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:41.760501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:41.760501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:41.760501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:41.760501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:41.760501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:41.760501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:41.760501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:41.761412 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:41.761412 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:41.761412 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:41.761412 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:41.761412 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:41.761412 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:41.761412 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:41.761412 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:41.761412 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:41.761412 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:41.761412 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:41.761412 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:41.761412 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:41.761412 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:41.761412 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:41.761412 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:41.762332 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:41.762332 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:41.762332 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:41.762332 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:41.762332 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:41.762332 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:41.762332 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:41.762332 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:41.762332 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:41.762332 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:41.762332 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:13:41.762332 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:41.762332 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 291/556] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 27 20:13:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:41.762332 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6f248-59f4-49fb-8a7c-3f46114689bb None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:41.841187 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d9cb9-5a50-4a63-8ead-34a9b58a1797 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:41.851708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:41.861064 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6f248-59f4-49fb-8a7c-3f46114689bb None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:41.875161 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8753fb-53a4-4f27-bf0f-97a373a712f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:41.876030 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8753fb-53a4-4f27-bf0f-97a373a712f2 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:41.876311 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8753fb-53a4-4f27-bf0f-97a373a712f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:41.876588 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8753fb-53a4-4f27-bf0f-97a373a712f2 None admin] PATH_INFO: `/v3/domains` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:41.876993 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:41.877272 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8753fb-53a4-4f27-bf0f-97a373a712f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:41.877579 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8753fb-53a4-4f27-bf0f-97a373a712f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:41.879154 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8753fb-53a4-4f27-bf0f-97a373a712f2 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:41.890585 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 266/557] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:41.891406 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8753fb-53a4-4f27-bf0f-97a373a712f2 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:41.895281 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b304d5c-8b9c-4f63-a650-ee568078ea6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:41.895914 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b304d5c-8b9c-4f63-a650-ee568078ea6f None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:41.896190 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b304d5c-8b9c-4f63-a650-ee568078ea6f None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:41.896456 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b304d5c-8b9c-4f63-a650-ee568078ea6f None admin] PATH_INFO: `/v3/users/glance` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:41.904320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b304d5c-8b9c-4f63-a650-ee568078ea6f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:41.905757 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b304d5c-8b9c-4f63-a650-ee568078ea6f None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:41.918029 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-9b304d5c-8b9c-4f63-a650-ee568078ea6f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 20:13:41.918029 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:41.918029 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:41.918029 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:41.918029 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:41.918029 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:41.918029 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:41.918029 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:41.918029 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:41.918029 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:41.918029 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:41.918029 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:41.918029 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 20:13:41.918029 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 20:13:41.918029 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 20:13:41.918029 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 20:13:41.919113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:41.919113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:41.919113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 20:13:41.919113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:41.919113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 20:13:41.919113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:41.919113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:41.919113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:41.919113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:41.919113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:41.919113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:41.919113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:41.919113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:41.919113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:41.919113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:41.919113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:41.919113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:41.919113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:41.920502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:41.920502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:41.920502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 20:13:41.920502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 20:13:41.920502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 20:13:41.920502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 20:13:41.920502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 20:13:41.920502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 20:13:41.920502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 20:13:41.920502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:41.920502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 292/558] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:41.920502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b304d5c-8b9c-4f63-a650-ee568078ea6f None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:41.994045 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8753fb-53a4-4f27-bf0f-97a373a712f2 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:42.016177 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b304d5c-8b9c-4f63-a650-ee568078ea6f None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:42.027501 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfe00c-27ff-4ab1-84e7-f7cc46a918c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:42.028123 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfe00c-27ff-4ab1-84e7-f7cc46a918c3 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:42.028403 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfe00c-27ff-4ab1-84e7-f7cc46a918c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:42.028677 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfe00c-27ff-4ab1-84e7-f7cc46a918c3 None admin] PATH_INFO: `/v3/projects` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:42.029418 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfe00c-27ff-4ab1-84e7-f7cc46a918c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:42.029723 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfe00c-27ff-4ab1-84e7-f7cc46a918c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:42.031181 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfe00c-27ff-4ab1-84e7-f7cc46a918c3 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:42.042896 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 267/559] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 27 20:13:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:42.043787 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfe00c-27ff-4ab1-84e7-f7cc46a918c3 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:42.049681 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1baf61-b7a3-4dcc-86c0-3a23fa4c000c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:42.050289 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1baf61-b7a3-4dcc-86c0-3a23fa4c000c None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:42.050564 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1baf61-b7a3-4dcc-86c0-3a23fa4c000c None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:42.050835 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1baf61-b7a3-4dcc-86c0-3a23fa4c000c None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:42.051577 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1baf61-b7a3-4dcc-86c0-3a23fa4c000c None admin] RBAC: Adding query filter params (name=service) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:42.051879 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1baf61-b7a3-4dcc-86c0-3a23fa4c000c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:42.053230 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1baf61-b7a3-4dcc-86c0-3a23fa4c000c None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:42.060970 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 293/560] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 27 20:13:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:42.061739 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1baf61-b7a3-4dcc-86c0-3a23fa4c000c None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:42.077406 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:42.101910 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:42.146185 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfe00c-27ff-4ab1-84e7-f7cc46a918c3 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:42.161069 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1baf61-b7a3-4dcc-86c0-3a23fa4c000c None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:42.179058 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc4d21-89c4-4778-88d9-9f75bc87e1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:42.179711 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc4d21-89c4-4778-88d9-9f75bc87e1b7 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:42.179988 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc4d21-89c4-4778-88d9-9f75bc87e1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:42.180551 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc4d21-89c4-4778-88d9-9f75bc87e1b7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:42.187386 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc4d21-89c4-4778-88d9-9f75bc87e1b7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:42.188807 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc4d21-89c4-4778-88d9-9f75bc87e1b7 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:42.193357 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1df576-6bd6-4ec1-b966-0a9f3d45c90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:42.193963 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1df576-6bd6-4ec1-b966-0a9f3d45c90b None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:42.194771 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1df576-6bd6-4ec1-b966-0a9f3d45c90b None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:42.195055 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1df576-6bd6-4ec1-b966-0a9f3d45c90b None admin] PATH_INFO: `/v3/users` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:42.195855 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1df576-6bd6-4ec1-b966-0a9f3d45c90b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:42.196157 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1df576-6bd6-4ec1-b966-0a9f3d45c90b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:42.197559 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1df576-6bd6-4ec1-b966-0a9f3d45c90b None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:42.200262 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-cafc4d21-89c4-4778-88d9-9f75bc87e1b7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 20:13:42.200262 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:42.200262 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:42.200262 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:42.200262 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:42.200262 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:42.200262 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:42.200262 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:42.200262 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:42.200262 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:42.200262 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:42.200262 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:42.200262 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 20:13:42.200262 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 20:13:42.200262 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 20:13:42.200262 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 20:13:42.201199 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:42.201199 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:42.201199 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 20:13:42.201199 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:42.201199 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 20:13:42.201199 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:42.201199 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:42.201199 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:42.201199 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:42.201199 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:42.201199 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:42.201199 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:42.201199 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:42.201199 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:42.201199 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:42.201199 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:42.201199 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:42.201199 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:42.202132 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:42.202132 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:42.202132 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 20:13:42.202132 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 20:13:42.202132 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 20:13:42.202132 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 20:13:42.202132 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 20:13:42.202132 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 20:13:42.202132 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 20:13:42.202132 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:42.202132 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 268/561] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:42.202132 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc4d21-89c4-4778-88d9-9f75bc87e1b7 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:42.215018 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 294/562] 10.222.0.83 () {56 vars in 1137 bytes} [Wed Jul 27 20:13:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:42.216067 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1df576-6bd6-4ec1-b966-0a9f3d45c90b None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:42.295098 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:42.306011 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc4d21-89c4-4778-88d9-9f75bc87e1b7 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:42.309234 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:42.315964 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1df576-6bd6-4ec1-b966-0a9f3d45c90b None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:42.340665 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9022401-5ef3-418f-808b-9eb07a4eb060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:42.341334 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9022401-5ef3-418f-808b-9eb07a4eb060 None admin] REQUEST_METHOD: `PUT` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:42.341613 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9022401-5ef3-418f-808b-9eb07a4eb060 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:42.341886 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9022401-5ef3-418f-808b-9eb07a4eb060 None admin] PATH_INFO: `/v3/projects/75313278ff3747909a57b6f37496d31e/users/f68b37524d7245e4b606ad8dd15442ef/roles/49069056c7b14e319599004c4af25dfb` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:42.350230 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ee992-42e6-4205-a4ad-854bb1d66ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:42.350889 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ee992-42e6-4205-a4ad-854bb1d66ae5 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:42.351203 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ee992-42e6-4205-a4ad-854bb1d66ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:42.351507 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ee992-42e6-4205-a4ad-854bb1d66ae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:42.355845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9022401-5ef3-418f-808b-9eb07a4eb060 None admin] RBAC: Authorizing `identity:create_grant(project_id=75313278ff3747909a57b6f37496d31e, user_id=f68b37524d7245e4b606ad8dd15442ef, role_id=49069056c7b14e319599004c4af25dfb)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:42.357285 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9022401-5ef3-418f-808b-9eb07a4eb060 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:42.361284 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ee992-42e6-4205-a4ad-854bb1d66ae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:42.362787 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ee992-42e6-4205-a4ad-854bb1d66ae5 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:42.369360 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 269/563] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 27 20:13:42 2022] PUT /identity/v3/projects/75313278ff3747909a57b6f37496d31e/users/f68b37524d7245e4b606ad8dd15442ef/roles/49069056c7b14e319599004c4af25dfb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:13:42.370234 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9022401-5ef3-418f-808b-9eb07a4eb060 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:42.384326 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-8e9ee992-42e6-4205-a4ad-854bb1d66ae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:42.384326 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:42.384326 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:42.384326 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:42.384326 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:42.384326 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:42.384326 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:42.384326 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:42.384326 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:42.384326 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:42.384326 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:42.384326 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:42.384326 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:42.384326 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:42.384326 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:42.385334 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:42.385334 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:42.385334 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:42.385334 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:42.385334 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:42.385334 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:42.385334 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:42.385334 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:42.385334 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:42.385334 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:42.385334 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:42.385334 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:42.385334 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:42.385334 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:42.385334 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:42.385334 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:42.385334 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:42.386208 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:42.386208 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:42.386208 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:42.386208 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:42.386208 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 295/564] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:42.387045 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ee992-42e6-4205-a4ad-854bb1d66ae5 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:42.496947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9022401-5ef3-418f-808b-9eb07a4eb060 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:42.501374 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ee992-42e6-4205-a4ad-854bb1d66ae5 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:42.535789 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f60a5-7352-407e-90e0-d7396d216767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:42.536731 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f60a5-7352-407e-90e0-d7396d216767 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:42.536845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f60a5-7352-407e-90e0-d7396d216767 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:42.537165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f60a5-7352-407e-90e0-d7396d216767 None admin] PATH_INFO: `/v3/users` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:42.538239 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f60a5-7352-407e-90e0-d7396d216767 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:42.538366 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f60a5-7352-407e-90e0-d7396d216767 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:42.541105 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f60a5-7352-407e-90e0-d7396d216767 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:42.541221 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef63aa-f7e2-4248-ae3d-9c886cee573d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:42.541404 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef63aa-f7e2-4248-ae3d-9c886cee573d None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:42.541671 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef63aa-f7e2-4248-ae3d-9c886cee573d None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:42.541925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef63aa-f7e2-4248-ae3d-9c886cee573d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:42.552900 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:42.556869 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef63aa-f7e2-4248-ae3d-9c886cee573d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:42.558330 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef63aa-f7e2-4248-ae3d-9c886cee573d None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:42.567312 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 270/565] 10.222.0.83 () {56 vars in 1137 bytes} [Wed Jul 27 20:13:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:42.568386 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f60a5-7352-407e-90e0-d7396d216767 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:42.568517 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:42.577023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-9cef63aa-f7e2-4248-ae3d-9c886cee573d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:42.577023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:42.577023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:42.577023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:42.577023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:42.577023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:42.577023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:42.577023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:42.577023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:42.577023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:42.577023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:42.577023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:42.577023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:42.577023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:42.577023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:42.578091 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:42.578091 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:42.578091 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:42.578091 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:42.578091 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:42.578091 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:42.578091 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:42.578091 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:42.578091 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:42.578091 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:42.578091 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:42.578091 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:42.578091 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:42.578091 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:42.578091 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:42.578091 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:42.578091 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:42.579213 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:42.579213 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:42.579213 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:42.579213 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:42.579213 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 296/566] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:42.580241 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef63aa-f7e2-4248-ae3d-9c886cee573d None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:42.678402 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f60a5-7352-407e-90e0-d7396d216767 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:42.683057 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef63aa-f7e2-4248-ae3d-9c886cee573d None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:42.718568 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8260ec4-0625-44cb-896e-7ed1497855b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:42.719729 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678b39b-e78d-4210-836c-8f3ee2d3f46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:42.720001 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8260ec4-0625-44cb-896e-7ed1497855b4 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:42.720364 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678b39b-e78d-4210-836c-8f3ee2d3f46c None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:42.720570 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8260ec4-0625-44cb-896e-7ed1497855b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:42.720676 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678b39b-e78d-4210-836c-8f3ee2d3f46c None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:42.720909 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678b39b-e78d-4210-836c-8f3ee2d3f46c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:42.721225 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8260ec4-0625-44cb-896e-7ed1497855b4 None admin] PATH_INFO: `/v3/domains` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:42.722044 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8260ec4-0625-44cb-896e-7ed1497855b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:42.722485 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8260ec4-0625-44cb-896e-7ed1497855b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:42.724152 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8260ec4-0625-44cb-896e-7ed1497855b4 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:42.732029 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678b39b-e78d-4210-836c-8f3ee2d3f46c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:42.733493 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678b39b-e78d-4210-836c-8f3ee2d3f46c None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:42.738477 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 271/567] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:42.739512 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8260ec4-0625-44cb-896e-7ed1497855b4 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:42.755130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-1678b39b-e78d-4210-836c-8f3ee2d3f46c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:42.755130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:42.755130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:42.755130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:42.755130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:42.755130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:42.755130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:42.755130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:42.755130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:42.755130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:42.755130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:42.755130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:42.755130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:42.755130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:42.755130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:42.756234 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:42.756234 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:42.756234 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:42.756234 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:42.756234 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:42.756234 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:42.756234 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:42.756234 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:42.756234 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:42.756234 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:42.756234 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:42.756234 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:42.756234 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:42.756234 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:42.756234 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:42.756234 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:42.756234 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:42.757195 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:42.757195 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:42.757195 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:42.757195 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:42.760706 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 297/568] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:42.761542 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678b39b-e78d-4210-836c-8f3ee2d3f46c None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:42.808389 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:42.817496 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:42.853326 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8260ec4-0625-44cb-896e-7ed1497855b4 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:42.870451 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678b39b-e78d-4210-836c-8f3ee2d3f46c None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:42.888472 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b06482-709c-48ca-847e-f34e5a646257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:42.889099 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b06482-709c-48ca-847e-f34e5a646257 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:42.889380 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b06482-709c-48ca-847e-f34e5a646257 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:42.889657 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b06482-709c-48ca-847e-f34e5a646257 None admin] PATH_INFO: `/v3/domains` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:42.890410 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b06482-709c-48ca-847e-f34e5a646257 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:42.890722 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b06482-709c-48ca-847e-f34e5a646257 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:42.892175 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b06482-709c-48ca-847e-f34e5a646257 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:42.904712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 272/569] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:42.905510 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b06482-709c-48ca-847e-f34e5a646257 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:42.919402 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945220e6-d5ba-494e-a9ee-d3a5aba2ece3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:42.920485 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945220e6-d5ba-494e-a9ee-d3a5aba2ece3 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:42.921004 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945220e6-d5ba-494e-a9ee-d3a5aba2ece3 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:42.921672 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945220e6-d5ba-494e-a9ee-d3a5aba2ece3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:42.933331 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945220e6-d5ba-494e-a9ee-d3a5aba2ece3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:42.935387 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945220e6-d5ba-494e-a9ee-d3a5aba2ece3 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:42.948005 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-945220e6-d5ba-494e-a9ee-d3a5aba2ece3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 20:13:42.948005 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:42.948005 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:42.948005 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:42.948005 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:42.948005 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:42.948005 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:42.948005 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:42.948005 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:42.948005 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:42.948005 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:42.948005 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:42.948005 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 20:13:42.948005 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 20:13:42.948005 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 20:13:42.948005 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 20:13:42.948943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:42.948943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:42.948943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 20:13:42.948943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:42.948943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 20:13:42.948943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:42.948943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:42.948943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:42.948943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:42.948943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:42.948943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:42.948943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:42.948943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:42.948943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:42.948943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:42.948943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:42.948943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:42.948943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:42.950048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:42.950048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:42.950048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 20:13:42.950048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 20:13:42.950048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 20:13:42.950048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 20:13:42.950048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 20:13:42.950048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 20:13:42.950048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 20:13:42.950048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:42.951945 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 298/570] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 27 20:13:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:42.952870 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945220e6-d5ba-494e-a9ee-d3a5aba2ece3 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:43.010174 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b06482-709c-48ca-847e-f34e5a646257 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:43.027646 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:43.045435 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76768953-0316-4961-9ab0-3c224d94347a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:43.046064 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76768953-0316-4961-9ab0-3c224d94347a None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:43.046340 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76768953-0316-4961-9ab0-3c224d94347a None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:43.046613 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76768953-0316-4961-9ab0-3c224d94347a None admin] PATH_INFO: `/v3/domains` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:43.047335 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76768953-0316-4961-9ab0-3c224d94347a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:43.047637 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76768953-0316-4961-9ab0-3c224d94347a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:43.048981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76768953-0316-4961-9ab0-3c224d94347a None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:43.064823 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 273/571] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:43.064823 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76768953-0316-4961-9ab0-3c224d94347a None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:43.067439 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945220e6-d5ba-494e-a9ee-d3a5aba2ece3 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:43.081618 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:43.104543 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6cf00-a32c-4f12-992a-a2bb865c049c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:43.105668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6cf00-a32c-4f12-992a-a2bb865c049c None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:43.106000 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6cf00-a32c-4f12-992a-a2bb865c049c None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:43.106275 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6cf00-a32c-4f12-992a-a2bb865c049c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:43.113673 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6cf00-a32c-4f12-992a-a2bb865c049c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:43.115374 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6cf00-a32c-4f12-992a-a2bb865c049c None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:43.127694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-b8f6cf00-a32c-4f12-992a-a2bb865c049c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:43.127694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:43.127694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:43.127694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:43.127694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:43.127694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:43.127694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:43.127694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:43.127694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:43.127694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:43.127694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:43.127694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:43.127694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 20:13:43.127694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 20:13:43.127694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 20:13:43.128602 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 20:13:43.128602 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:43.128602 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:43.128602 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:43.128602 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:43.128602 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:43.128602 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:43.128602 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:43.128602 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:43.128602 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:43.128602 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:43.128602 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:43.128602 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:43.128602 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:43.128602 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:43.128602 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:43.128602 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:43.129498 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 20:13:43.129498 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 20:13:43.129498 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 20:13:43.129498 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 20:13:43.129498 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 20:13:43.129498 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 20:13:43.129498 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:43.129498 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:43.134071 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 299/572] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:13:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:43.135021 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6cf00-a32c-4f12-992a-a2bb865c049c None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:43.165790 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76768953-0316-4961-9ab0-3c224d94347a None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:43.202539 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aee078-98a4-4d41-9c41-6d989e96177b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:43.203181 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aee078-98a4-4d41-9c41-6d989e96177b None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:43.203462 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aee078-98a4-4d41-9c41-6d989e96177b None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:43.203732 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aee078-98a4-4d41-9c41-6d989e96177b None admin] PATH_INFO: `/v3/users` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:43.204515 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aee078-98a4-4d41-9c41-6d989e96177b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:43.204820 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aee078-98a4-4d41-9c41-6d989e96177b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:43.206234 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aee078-98a4-4d41-9c41-6d989e96177b None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:43.227897 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 274/573] 10.222.0.83 () {56 vars in 1139 bytes} [Wed Jul 27 20:13:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:43.227897 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aee078-98a4-4d41-9c41-6d989e96177b None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:43.245426 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6cf00-a32c-4f12-992a-a2bb865c049c None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:43.259187 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:43.283065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb78150-28e0-4113-a6d7-8e783ad6879c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:43.283726 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb78150-28e0-4113-a6d7-8e783ad6879c None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:43.284016 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb78150-28e0-4113-a6d7-8e783ad6879c None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:43.284275 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb78150-28e0-4113-a6d7-8e783ad6879c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:43.291268 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb78150-28e0-4113-a6d7-8e783ad6879c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:43.292704 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb78150-28e0-4113-a6d7-8e783ad6879c None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:43.306577 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-acb78150-28e0-4113-a6d7-8e783ad6879c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:43.306577 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:43.306577 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:43.306577 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:43.306577 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:43.306577 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:43.306577 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:43.306577 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:43.306577 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:43.306577 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:43.306577 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:43.306577 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:43.306577 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 20:13:43.306577 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 20:13:43.306577 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 20:13:43.307530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 20:13:43.307530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:43.307530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:43.307530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:43.307530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:43.307530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:43.307530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:43.307530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:43.307530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:43.307530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:43.307530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:43.307530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:43.307530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:43.307530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:43.307530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:43.307530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:43.307530 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:43.308418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 20:13:43.308418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 20:13:43.308418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 20:13:43.308418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 20:13:43.308418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 20:13:43.308418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 20:13:43.308418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:43.308418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:43.308418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 300/574] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:13:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:43.308889 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb78150-28e0-4113-a6d7-8e783ad6879c None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:43.335168 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aee078-98a4-4d41-9c41-6d989e96177b None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:43.349912 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:43.370726 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95754b8-84ca-41d1-bea7-56917925ca65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:43.371374 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95754b8-84ca-41d1-bea7-56917925ca65 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:43.371656 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95754b8-84ca-41d1-bea7-56917925ca65 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:43.371924 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95754b8-84ca-41d1-bea7-56917925ca65 None admin] PATH_INFO: `/v3/projects` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:43.372663 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95754b8-84ca-41d1-bea7-56917925ca65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:43.372968 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95754b8-84ca-41d1-bea7-56917925ca65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:43.374381 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95754b8-84ca-41d1-bea7-56917925ca65 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:43.386960 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 275/575] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 27 20:13:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:43.387771 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95754b8-84ca-41d1-bea7-56917925ca65 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:43.430121 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb78150-28e0-4113-a6d7-8e783ad6879c None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:43.466106 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a50289-b124-4ab5-aaa4-3c9c5387854c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:43.466653 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a50289-b124-4ab5-aaa4-3c9c5387854c None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:43.466939 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a50289-b124-4ab5-aaa4-3c9c5387854c None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:43.467259 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a50289-b124-4ab5-aaa4-3c9c5387854c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:43.478222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a50289-b124-4ab5-aaa4-3c9c5387854c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:43.479699 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a50289-b124-4ab5-aaa4-3c9c5387854c None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:43.485735 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:43.493226 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95754b8-84ca-41d1-bea7-56917925ca65 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:43.494990 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-76a50289-b124-4ab5-aaa4-3c9c5387854c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:43.494990 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:43.494990 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:43.494990 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:43.494990 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:43.494990 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:43.494990 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:43.494990 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:43.494990 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:43.494990 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:43.494990 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:43.494990 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:43.494990 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:43.494990 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:43.494990 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:43.495870 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:43.495870 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:43.495870 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:43.495870 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:43.495870 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:43.495870 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:43.495870 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:43.495870 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:43.495870 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:43.495870 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:43.495870 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:43.495870 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:43.495870 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:43.495870 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:43.495870 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:43.495870 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:43.495870 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:43.496753 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:43.496753 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:43.496753 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:43.496753 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:43.496753 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 301/576] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:43.497036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a50289-b124-4ab5-aaa4-3c9c5387854c None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:43.533747 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720b7c5-a18c-42be-a161-bfbb73af4359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:43.534368 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720b7c5-a18c-42be-a161-bfbb73af4359 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:43.534641 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720b7c5-a18c-42be-a161-bfbb73af4359 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:43.534912 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720b7c5-a18c-42be-a161-bfbb73af4359 None admin] PATH_INFO: `/v3/projects` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:43.535692 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720b7c5-a18c-42be-a161-bfbb73af4359 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:43.536000 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720b7c5-a18c-42be-a161-bfbb73af4359 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:43.537420 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720b7c5-a18c-42be-a161-bfbb73af4359 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:43.554635 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 276/577] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 27 20:13:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:43.554635 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720b7c5-a18c-42be-a161-bfbb73af4359 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:43.599835 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:43.617962 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a50289-b124-4ab5-aaa4-3c9c5387854c None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:43.653133 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c85eaf-90b5-4eb6-b132-949a0bd30e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:43.653793 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c85eaf-90b5-4eb6-b132-949a0bd30e38 None admin] REQUEST_METHOD: `PUT` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:43.654073 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c85eaf-90b5-4eb6-b132-949a0bd30e38 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:43.654348 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c85eaf-90b5-4eb6-b132-949a0bd30e38 None admin] PATH_INFO: `/v3/projects/75313278ff3747909a57b6f37496d31e/users/04dc74146aed49cb98441ea945847379/roles/49069056c7b14e319599004c4af25dfb` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:43.656383 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720b7c5-a18c-42be-a161-bfbb73af4359 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:43.668941 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c85eaf-90b5-4eb6-b132-949a0bd30e38 None admin] RBAC: Authorizing `identity:create_grant(project_id=75313278ff3747909a57b6f37496d31e, user_id=04dc74146aed49cb98441ea945847379, role_id=49069056c7b14e319599004c4af25dfb)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:43.670521 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c85eaf-90b5-4eb6-b132-949a0bd30e38 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:43.691119 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 302/578] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 27 20:13:43 2022] PUT /identity/v3/projects/75313278ff3747909a57b6f37496d31e/users/04dc74146aed49cb98441ea945847379/roles/49069056c7b14e319599004c4af25dfb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:13:43.691119 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c85eaf-90b5-4eb6-b132-949a0bd30e38 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:43.703296 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719420a-4f85-456a-94b2-d6777489a2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:43.704029 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719420a-4f85-456a-94b2-d6777489a2a8 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:43.704376 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719420a-4f85-456a-94b2-d6777489a2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:43.704717 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719420a-4f85-456a-94b2-d6777489a2a8 None admin] PATH_INFO: `/v3/domains` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:43.705489 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719420a-4f85-456a-94b2-d6777489a2a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:43.705845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719420a-4f85-456a-94b2-d6777489a2a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:43.707372 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719420a-4f85-456a-94b2-d6777489a2a8 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:43.727049 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 277/579] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:43.728066 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719420a-4f85-456a-94b2-d6777489a2a8 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:43.751189 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:43.833764 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c85eaf-90b5-4eb6-b132-949a0bd30e38 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:43.873033 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efed44e-e91f-4b9c-a2dc-c88ccb2c6fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:43.873623 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efed44e-e91f-4b9c-a2dc-c88ccb2c6fad None admin] REQUEST_METHOD: `PUT` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:43.873897 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efed44e-e91f-4b9c-a2dc-c88ccb2c6fad None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:43.874166 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efed44e-e91f-4b9c-a2dc-c88ccb2c6fad None admin] PATH_INFO: `/v3/projects/75313278ff3747909a57b6f37496d31e/users/4bf3f75970b342609acb2542913b068d/roles/49069056c7b14e319599004c4af25dfb` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:43.875111 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719420a-4f85-456a-94b2-d6777489a2a8 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:43.877246 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:43.892638 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efed44e-e91f-4b9c-a2dc-c88ccb2c6fad None admin] RBAC: Authorizing `identity:create_grant(project_id=75313278ff3747909a57b6f37496d31e, user_id=4bf3f75970b342609acb2542913b068d, role_id=49069056c7b14e319599004c4af25dfb)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:43.894299 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efed44e-e91f-4b9c-a2dc-c88ccb2c6fad None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:43.912448 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 303/580] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 27 20:13:43 2022] PUT /identity/v3/projects/75313278ff3747909a57b6f37496d31e/users/4bf3f75970b342609acb2542913b068d/roles/49069056c7b14e319599004c4af25dfb => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:13:43.932312 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f611e-9f13-478a-a184-ed074e7384fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:43.933158 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f611e-9f13-478a-a184-ed074e7384fd None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:43.933556 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f611e-9f13-478a-a184-ed074e7384fd None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:43.933830 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f611e-9f13-478a-a184-ed074e7384fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:43.949950 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f611e-9f13-478a-a184-ed074e7384fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:43.952051 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f611e-9f13-478a-a184-ed074e7384fd None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:43.965607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-fd6f611e-9f13-478a-a184-ed074e7384fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:43.965607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:43.965607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:43.965607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:43.965607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:43.965607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:43.965607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:43.965607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:43.965607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:43.965607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:43.965607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:43.965607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:43.965607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 20:13:43.965607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 20:13:43.965607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 20:13:43.966574 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 20:13:43.966574 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:43.966574 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:43.966574 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:43.966574 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:43.966574 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:43.966574 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:43.966574 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:43.966574 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:43.966574 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:43.966574 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:43.966574 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:43.966574 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:43.966574 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:43.966574 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:43.966574 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:43.966574 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:43.967566 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 20:13:43.967566 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 20:13:43.967566 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 20:13:43.967566 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 20:13:43.967566 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 20:13:43.967566 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 20:13:43.967566 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:43.967566 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:43.970286 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 278/581] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:13:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:43.976531 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efed44e-e91f-4b9c-a2dc-c88ccb2c6fad None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:44.090940 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efed44e-e91f-4b9c-a2dc-c88ccb2c6fad None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:44.126934 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0ea0d-4cfe-4911-8b68-ae4a7113127b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:44.127510 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0ea0d-4cfe-4911-8b68-ae4a7113127b None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:44.127787 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0ea0d-4cfe-4911-8b68-ae4a7113127b None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:44.128051 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0ea0d-4cfe-4911-8b68-ae4a7113127b None admin] PATH_INFO: `/v3/projects` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:44.128793 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0ea0d-4cfe-4911-8b68-ae4a7113127b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:44.129095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0ea0d-4cfe-4911-8b68-ae4a7113127b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:44.130524 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0ea0d-4cfe-4911-8b68-ae4a7113127b None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:44.142745 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 304/582] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 27 20:13:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:44.149103 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f611e-9f13-478a-a184-ed074e7384fd None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:44.235109 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:44.260761 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f611e-9f13-478a-a184-ed074e7384fd None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:44.302482 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93994130-94d8-4177-bbf7-3f61288678c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:44.303575 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93994130-94d8-4177-bbf7-3f61288678c7 None admin] REQUEST_METHOD: `PUT` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:44.303996 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93994130-94d8-4177-bbf7-3f61288678c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:44.304466 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93994130-94d8-4177-bbf7-3f61288678c7 None admin] PATH_INFO: `/v3/projects/75313278ff3747909a57b6f37496d31e/users/308f029a3e7b46fbaff75a01720c8986/roles/49069056c7b14e319599004c4af25dfb` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:44.320971 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93994130-94d8-4177-bbf7-3f61288678c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=75313278ff3747909a57b6f37496d31e, user_id=308f029a3e7b46fbaff75a01720c8986, role_id=49069056c7b14e319599004c4af25dfb)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:44.322714 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93994130-94d8-4177-bbf7-3f61288678c7 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:44.341814 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 279/583] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 27 20:13:44 2022] PUT /identity/v3/projects/75313278ff3747909a57b6f37496d31e/users/308f029a3e7b46fbaff75a01720c8986/roles/49069056c7b14e319599004c4af25dfb => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:13:44.651442 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212c462-f81e-4e96-8a71-595e31b45fe3 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:44.651865 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212c462-f81e-4e96-8a71-595e31b45fe3 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:44.651977 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212c462-f81e-4e96-8a71-595e31b45fe3 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:44.653585 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 305/584] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:44.659129 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7737a6-ae21-439b-bd4c-1c0d507393b6 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:44.659431 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7737a6-ae21-439b-bd4c-1c0d507393b6 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:44.659711 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7737a6-ae21-439b-bd4c-1c0d507393b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:44.677782 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-cc7737a6-ae21-439b-bd4c-1c0d507393b6 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:44.679006 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-cc7737a6-ae21-439b-bd4c-1c0d507393b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:44.755182 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 280/585] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:44.774641 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212c462-f81e-4e96-8a71-595e31b45fe3 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:44.824790 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:44.883573 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212c462-f81e-4e96-8a71-595e31b45fe3 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:44.920639 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b17ec-77c9-4ba0-bf57-80490abe5e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:44.921188 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b17ec-77c9-4ba0-bf57-80490abe5e6d None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:44.921474 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b17ec-77c9-4ba0-bf57-80490abe5e6d None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:44.921748 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b17ec-77c9-4ba0-bf57-80490abe5e6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:44.933979 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b17ec-77c9-4ba0-bf57-80490abe5e6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:44.939551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-782b17ec-77c9-4ba0-bf57-80490abe5e6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:13:44.939551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:44.939551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:44.939551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:44.939551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:44.939551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:44.939551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:44.939551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:44.939551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:44.939551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:44.939551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:44.939551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:44.939551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:44.939551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:44.939551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:44.939551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:44.940668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:44.940668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:44.940668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:44.940668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:44.940668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:44.940668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:44.940668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:44.940668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:44.940668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:44.940668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:44.940668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:44.940668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:44.940668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:44.940668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:44.940668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:44.940668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:44.942101 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:44.942101 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:44.942101 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:44.942101 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:44.942101 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:44.942101 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:44.942101 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:44.942101 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:44.942101 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:44.942101 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:44.942101 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:13:44.942101 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:44.942101 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 306/586] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 27 20:13:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:44.949805 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7737a6-ae21-439b-bd4c-1c0d507393b6 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:45.017669 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:45.064408 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7737a6-ae21-439b-bd4c-1c0d507393b6 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:45.098942 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c0ae1-377c-4c71-8bf8-f4631b6bf664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:45.099607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c0ae1-377c-4c71-8bf8-f4631b6bf664 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:45.099887 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c0ae1-377c-4c71-8bf8-f4631b6bf664 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:45.100161 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c0ae1-377c-4c71-8bf8-f4631b6bf664 None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:45.100897 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c0ae1-377c-4c71-8bf8-f4631b6bf664 None admin] RBAC: Adding query filter params (name=service) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:45.101200 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c0ae1-377c-4c71-8bf8-f4631b6bf664 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:45.102627 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c0ae1-377c-4c71-8bf8-f4631b6bf664 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:45.111221 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 281/587] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 27 20:13:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:45.120147 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b17ec-77c9-4ba0-bf57-80490abe5e6d None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:45.229299 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b17ec-77c9-4ba0-bf57-80490abe5e6d None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:45.232043 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:45.265631 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b56d7-378a-45a8-af15-8052cf2d1e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:45.266639 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b56d7-378a-45a8-af15-8052cf2d1e7c None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:45.267175 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b56d7-378a-45a8-af15-8052cf2d1e7c None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:45.267670 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b56d7-378a-45a8-af15-8052cf2d1e7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:45.278644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b56d7-378a-45a8-af15-8052cf2d1e7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:45.280366 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b56d7-378a-45a8-af15-8052cf2d1e7c None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:45.295368 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-4a7b56d7-378a-45a8-af15-8052cf2d1e7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:45.295368 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:45.295368 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:45.295368 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:45.295368 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:45.295368 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:45.295368 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:45.295368 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:45.295368 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:45.295368 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:45.295368 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:45.295368 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:45.295368 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:45.295368 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:45.295368 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:45.296281 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:45.296281 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:45.296281 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:45.296281 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:45.296281 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:45.296281 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:45.296281 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:45.296281 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:45.296281 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:45.296281 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:45.296281 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:45.296281 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:45.296281 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:45.296281 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:45.296281 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:45.296281 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:45.296281 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:45.297160 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:45.297160 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:45.297160 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:45.297160 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:45.303169 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 307/588] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:45.305745 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c0ae1-377c-4c71-8bf8-f4631b6bf664 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:45.413339 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c0ae1-377c-4c71-8bf8-f4631b6bf664 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:45.430883 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:45.447638 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2dbd1-4142-4780-a9b4-e5f2aa8daa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:45.448260 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2dbd1-4142-4780-a9b4-e5f2aa8daa9e None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:45.448539 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2dbd1-4142-4780-a9b4-e5f2aa8daa9e None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:45.448812 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2dbd1-4142-4780-a9b4-e5f2aa8daa9e None admin] PATH_INFO: `/v3/domains` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:45.449503 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2dbd1-4142-4780-a9b4-e5f2aa8daa9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:45.449807 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2dbd1-4142-4780-a9b4-e5f2aa8daa9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:45.451196 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2dbd1-4142-4780-a9b4-e5f2aa8daa9e None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:45.463480 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 282/589] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:45.469120 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b56d7-378a-45a8-af15-8052cf2d1e7c None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:45.572904 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b56d7-378a-45a8-af15-8052cf2d1e7c None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:45.608683 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a3b92-d9a4-4f4a-ba03-5bb2919ee9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:45.609750 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a3b92-d9a4-4f4a-ba03-5bb2919ee9a5 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:45.610253 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a3b92-d9a4-4f4a-ba03-5bb2919ee9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:45.610821 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a3b92-d9a4-4f4a-ba03-5bb2919ee9a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:45.619975 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a3b92-d9a4-4f4a-ba03-5bb2919ee9a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:45.621817 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a3b92-d9a4-4f4a-ba03-5bb2919ee9a5 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:45.634653 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-7d5a3b92-d9a4-4f4a-ba03-5bb2919ee9a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 20:13:45.634653 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:45.634653 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:45.634653 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:45.634653 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:45.634653 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:45.634653 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:45.634653 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:45.634653 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:45.634653 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:45.634653 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:45.634653 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:45.634653 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 20:13:45.634653 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 20:13:45.634653 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 20:13:45.634653 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 20:13:45.635708 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:45.635708 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:45.635708 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 20:13:45.635708 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:45.635708 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 20:13:45.635708 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:45.635708 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:45.635708 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:45.635708 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:45.635708 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:45.635708 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:45.635708 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:45.635708 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:45.635708 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:45.635708 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:45.635708 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:45.635708 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:45.635708 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:45.636644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:45.636644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:45.636644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 20:13:45.636644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 20:13:45.636644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 20:13:45.636644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 20:13:45.636644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 20:13:45.636644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 20:13:45.636644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 20:13:45.636644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:45.643167 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 308/590] 10.222.0.83 () {56 vars in 1093 bytes} [Wed Jul 27 20:13:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:45.648661 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2dbd1-4142-4780-a9b4-e5f2aa8daa9e None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:45.751346 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2dbd1-4142-4780-a9b4-e5f2aa8daa9e None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:45.790997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35176b-6fdb-43fd-bd9d-5d5640d55c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:45.791667 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35176b-6fdb-43fd-bd9d-5d5640d55c37 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:45.791929 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35176b-6fdb-43fd-bd9d-5d5640d55c37 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:45.792202 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35176b-6fdb-43fd-bd9d-5d5640d55c37 None admin] PATH_INFO: `/v3/users` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:45.792991 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35176b-6fdb-43fd-bd9d-5d5640d55c37 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:45.793293 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35176b-6fdb-43fd-bd9d-5d5640d55c37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:45.794730 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35176b-6fdb-43fd-bd9d-5d5640d55c37 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:45.813016 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 283/591] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Jul 27 20:13:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:45.818692 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a3b92-d9a4-4f4a-ba03-5bb2919ee9a5 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:45.844369 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:45.933627 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a3b92-d9a4-4f4a-ba03-5bb2919ee9a5 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:45.969692 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c851b-587b-45fc-92e5-3c0f1a24baf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:45.970673 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c851b-587b-45fc-92e5-3c0f1a24baf7 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:45.971408 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c851b-587b-45fc-92e5-3c0f1a24baf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:45.972005 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c851b-587b-45fc-92e5-3c0f1a24baf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:46.043181 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c851b-587b-45fc-92e5-3c0f1a24baf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:46.044659 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c851b-587b-45fc-92e5-3c0f1a24baf7 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:46.061675 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:46.067979 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa6c2e-a694-4de3-be41-5567a7928d5d None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:46.068263 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa6c2e-a694-4de3-be41-5567a7928d5d None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:46.068538 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa6c2e-a694-4de3-be41-5567a7928d5d None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:46.070765 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 284/592] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:46.076365 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af581f-d6f4-496e-ab5b-e524f9cca663 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:46.076646 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af581f-d6f4-496e-ab5b-e524f9cca663 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:46.076901 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af581f-d6f4-496e-ab5b-e524f9cca663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:46.103177 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-b5af581f-d6f4-496e-ab5b-e524f9cca663 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:46.105066 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-b5af581f-d6f4-496e-ab5b-e524f9cca663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:46.148833 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:46.150100 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 309/593] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:13:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:46.160215 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c851b-587b-45fc-92e5-3c0f1a24baf7 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:46.201325 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 285/594] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:46.225419 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af581f-d6f4-496e-ab5b-e524f9cca663 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:46.296453 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c851b-587b-45fc-92e5-3c0f1a24baf7 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:46.319716 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:46.338348 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46d049-3019-4ac8-8a9e-d8725e5f74e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:46.338994 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46d049-3019-4ac8-8a9e-d8725e5f74e3 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:46.339300 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46d049-3019-4ac8-8a9e-d8725e5f74e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:46.339571 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46d049-3019-4ac8-8a9e-d8725e5f74e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:46.342801 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af581f-d6f4-496e-ab5b-e524f9cca663 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:46.350055 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46d049-3019-4ac8-8a9e-d8725e5f74e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:46.351572 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46d049-3019-4ac8-8a9e-d8725e5f74e3 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:46.367993 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-cc46d049-3019-4ac8-8a9e-d8725e5f74e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:46.367993 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:46.367993 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:46.367993 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:46.367993 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:46.367993 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:46.367993 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:46.367993 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:46.367993 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:46.367993 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:46.367993 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:46.367993 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:46.367993 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:46.367993 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:46.367993 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:46.368878 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:46.368878 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:46.368878 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:46.368878 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:46.368878 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:46.368878 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:46.368878 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:46.368878 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:46.368878 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:46.368878 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:46.368878 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:46.368878 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:46.368878 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:46.368878 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:46.368878 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:46.368878 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:46.368878 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:46.370390 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:46.370390 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:46.370390 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:46.370390 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:46.370390 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 310/595] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:46.371199 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408fb0e-6630-499e-b32d-bb1e8c068889 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:46.371551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408fb0e-6630-499e-b32d-bb1e8c068889 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:46.371894 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408fb0e-6630-499e-b32d-bb1e8c068889 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:46.373358 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 311/596] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:46.378231 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408fb0e-6630-499e-b32d-bb1e8c068889 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:46.384915 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb5ae9-3691-4e18-be07-ca162549fef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:46.385590 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb5ae9-3691-4e18-be07-ca162549fef3 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:46.385845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb5ae9-3691-4e18-be07-ca162549fef3 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:46.386117 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb5ae9-3691-4e18-be07-ca162549fef3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:46.398509 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb5ae9-3691-4e18-be07-ca162549fef3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:46.403629 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-21bb5ae9-3691-4e18-be07-ca162549fef3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:13:46.403629 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:46.403629 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:46.403629 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:46.403629 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:46.403629 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:46.403629 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:46.403629 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:46.403629 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:46.403629 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:46.403629 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:46.403629 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:46.403629 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:46.403629 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:46.403629 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:46.403629 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:46.404545 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:46.404545 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:46.404545 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:46.404545 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:46.404545 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:46.404545 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:46.404545 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:46.404545 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:46.404545 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:46.404545 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:46.404545 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:46.404545 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:46.404545 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:46.404545 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:46.404545 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:46.404545 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:46.405399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:46.405399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:46.405399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:46.405399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:46.405399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:46.405399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:46.405399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:46.405399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:46.405399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:46.405399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:46.405399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:13:46.405399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:46.405399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 286/597] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 27 20:13:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:13:46.406597 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c43dd9-0cba-4294-8bf1-921c5823fae4 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:46.406597 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c43dd9-0cba-4294-8bf1-921c5823fae4 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:46.406597 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c43dd9-0cba-4294-8bf1-921c5823fae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:46.424631 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-92c43dd9-0cba-4294-8bf1-921c5823fae4 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:46.425804 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-92c43dd9-0cba-4294-8bf1-921c5823fae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:46.449365 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:46.491183 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408fb0e-6630-499e-b32d-bb1e8c068889 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:46.501795 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 287/598] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:46.503928 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c43dd9-0cba-4294-8bf1-921c5823fae4 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:46.529891 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf859f03-01a0-41ec-aef2-dc4d9c1d3a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:46.530505 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf859f03-01a0-41ec-aef2-dc4d9c1d3a8a None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:46.530778 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf859f03-01a0-41ec-aef2-dc4d9c1d3a8a None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:46.531043 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf859f03-01a0-41ec-aef2-dc4d9c1d3a8a None admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:46.531749 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf859f03-01a0-41ec-aef2-dc4d9c1d3a8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:46.532377 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf859f03-01a0-41ec-aef2-dc4d9c1d3a8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:46.533393 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf859f03-01a0-41ec-aef2-dc4d9c1d3a8a None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:46.545759 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 312/599] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:46.546684 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf859f03-01a0-41ec-aef2-dc4d9c1d3a8a None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:46.578262 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:46.620766 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c43dd9-0cba-4294-8bf1-921c5823fae4 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:46.656614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf859f03-01a0-41ec-aef2-dc4d9c1d3a8a None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:46.658484 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea604332-3a52-40ee-9bd1-c7c809190c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:46.659159 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea604332-3a52-40ee-9bd1-c7c809190c3a None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:46.659445 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea604332-3a52-40ee-9bd1-c7c809190c3a None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:46.659707 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea604332-3a52-40ee-9bd1-c7c809190c3a None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:46.660439 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea604332-3a52-40ee-9bd1-c7c809190c3a None admin] RBAC: Adding query filter params (name=service) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:46.660742 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea604332-3a52-40ee-9bd1-c7c809190c3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:46.662139 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea604332-3a52-40ee-9bd1-c7c809190c3a None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:46.675996 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 288/600] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 27 20:13:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:46.675996 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea604332-3a52-40ee-9bd1-c7c809190c3a None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:46.697358 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:46.700749 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eec97-1bb3-42c4-98d9-dc4e9f3306ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:46.701470 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eec97-1bb3-42c4-98d9-dc4e9f3306ac None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:46.701746 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eec97-1bb3-42c4-98d9-dc4e9f3306ac None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:46.702029 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eec97-1bb3-42c4-98d9-dc4e9f3306ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:46.712698 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2eec97-1bb3-42c4-98d9-dc4e9f3306ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:46.717590 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-ba2eec97-1bb3-42c4-98d9-dc4e9f3306ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:13:46.717590 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:46.717590 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:46.717590 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:46.717590 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:46.717590 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:46.717590 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:46.717590 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:46.717590 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:46.717590 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:46.717590 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:46.717590 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:46.717590 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:46.717590 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:46.717590 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:46.717590 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:46.718525 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:46.718525 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:46.718525 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:46.718525 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:46.718525 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:46.718525 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:46.718525 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:46.718525 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:46.718525 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:46.718525 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:46.718525 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:46.718525 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:46.718525 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:46.718525 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:46.718525 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:46.718525 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:46.724443 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:46.724443 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:46.724443 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:46.724443 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:46.724443 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:46.724443 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:46.724443 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:46.724443 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:46.724443 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:46.724443 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:46.724443 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:13:46.724443 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:46.724443 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 313/601] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 27 20:13:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:46.724443 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eec97-1bb3-42c4-98d9-dc4e9f3306ac None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:46.795549 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea604332-3a52-40ee-9bd1-c7c809190c3a None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:46.818699 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:46.830784 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d4a8b-bab0-408a-b97b-e857994d6e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:46.831342 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eec97-1bb3-42c4-98d9-dc4e9f3306ac None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:46.831541 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d4a8b-bab0-408a-b97b-e857994d6e7f None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:46.831737 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d4a8b-bab0-408a-b97b-e857994d6e7f None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:46.832005 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d4a8b-bab0-408a-b97b-e857994d6e7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:46.838501 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d4a8b-bab0-408a-b97b-e857994d6e7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:46.839959 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d4a8b-bab0-408a-b97b-e857994d6e7f None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:46.851415 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-798d4a8b-bab0-408a-b97b-e857994d6e7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:46.851415 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:46.851415 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:46.851415 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:46.851415 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:46.851415 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:46.851415 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:46.851415 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:46.851415 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:46.851415 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:46.851415 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:46.851415 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:46.851415 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 20:13:46.851415 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 20:13:46.851415 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 20:13:46.852348 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 20:13:46.852348 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:46.852348 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:46.852348 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:46.852348 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:46.852348 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:46.852348 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:46.852348 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:46.852348 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:46.852348 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:46.852348 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:46.852348 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:46.852348 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:46.852348 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:46.852348 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:46.852348 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:46.852348 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:46.853274 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 20:13:46.853274 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 20:13:46.853274 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 20:13:46.853274 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 20:13:46.853274 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 20:13:46.853274 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 20:13:46.853274 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:46.853274 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:46.853274 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 289/602] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:13:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:46.853274 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d4a8b-bab0-408a-b97b-e857994d6e7f None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:46.870269 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369a73e-cddb-4fd6-9768-56582fdd35f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:46.870960 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369a73e-cddb-4fd6-9768-56582fdd35f1 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:46.871215 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369a73e-cddb-4fd6-9768-56582fdd35f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:46.871492 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369a73e-cddb-4fd6-9768-56582fdd35f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:46.882294 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369a73e-cddb-4fd6-9768-56582fdd35f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:46.883783 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369a73e-cddb-4fd6-9768-56582fdd35f1 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:46.897481 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-e369a73e-cddb-4fd6-9768-56582fdd35f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:46.897481 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:46.897481 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:46.897481 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:46.897481 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:46.897481 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:46.897481 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:46.897481 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:46.897481 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:46.897481 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:46.897481 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:46.897481 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:46.897481 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:46.897481 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:46.897481 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:46.898401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:46.898401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:46.898401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:46.898401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:46.898401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:46.898401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:46.898401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:46.898401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:46.898401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:46.898401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:46.898401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:46.898401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:46.898401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:46.898401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:46.898401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:46.898401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:46.898401 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:46.899318 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:46.899318 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:46.899318 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:46.899318 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:46.899318 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 314/603] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:46.900130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363eb8e-fa1e-4805-95a2-b89c1464012e None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:46.900498 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363eb8e-fa1e-4805-95a2-b89c1464012e None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:46.900789 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363eb8e-fa1e-4805-95a2-b89c1464012e None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:46.905925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 315/604] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:46.905925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363eb8e-fa1e-4805-95a2-b89c1464012e None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:46.935647 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:46.957046 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d4a8b-bab0-408a-b97b-e857994d6e7f None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:46.990256 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056890d-ec02-435d-8d32-d0f717d5208d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:46.991510 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056890d-ec02-435d-8d32-d0f717d5208d None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:46.991795 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056890d-ec02-435d-8d32-d0f717d5208d None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:46.992074 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056890d-ec02-435d-8d32-d0f717d5208d None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:46.992791 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056890d-ec02-435d-8d32-d0f717d5208d None admin] RBAC: Adding query filter params (name=service) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:46.993097 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056890d-ec02-435d-8d32-d0f717d5208d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:46.994462 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056890d-ec02-435d-8d32-d0f717d5208d None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:47.002771 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 290/605] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 27 20:13:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:47.003763 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056890d-ec02-435d-8d32-d0f717d5208d None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:47.008709 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363eb8e-fa1e-4805-95a2-b89c1464012e None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:47.043005 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b658e8-ab2e-4d54-8a18-dd2fbcd04756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:47.043653 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b658e8-ab2e-4d54-8a18-dd2fbcd04756 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:47.043932 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b658e8-ab2e-4d54-8a18-dd2fbcd04756 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:47.044205 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b658e8-ab2e-4d54-8a18-dd2fbcd04756 None admin] PATH_INFO: `/v3/projects` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:47.044948 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b658e8-ab2e-4d54-8a18-dd2fbcd04756 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:47.045247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b658e8-ab2e-4d54-8a18-dd2fbcd04756 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:47.046680 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b658e8-ab2e-4d54-8a18-dd2fbcd04756 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:47.056468 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:47.060397 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 316/606] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 27 20:13:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:47.061707 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71bb33-114a-48fa-89ac-f88f8f54fc16 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:47.062051 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71bb33-114a-48fa-89ac-f88f8f54fc16 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:47.062380 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71bb33-114a-48fa-89ac-f88f8f54fc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:47.079840 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-4b71bb33-114a-48fa-89ac-f88f8f54fc16 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:47.081027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-4b71bb33-114a-48fa-89ac-f88f8f54fc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:47.111583 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056890d-ec02-435d-8d32-d0f717d5208d None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:47.144470 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf790c-300a-462a-b846-0c247d326fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:47.145163 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf790c-300a-462a-b846-0c247d326fc5 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:47.145550 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf790c-300a-462a-b846-0c247d326fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:47.145823 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf790c-300a-462a-b846-0c247d326fc5 None admin] PATH_INFO: `/v3/domains` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:47.146416 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 317/607] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:47.153299 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf790c-300a-462a-b846-0c247d326fc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:47.153299 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf790c-300a-462a-b846-0c247d326fc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:47.153509 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71bb33-114a-48fa-89ac-f88f8f54fc16 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:47.153603 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf790c-300a-462a-b846-0c247d326fc5 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:47.167853 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:47.175978 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 291/608] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:47.176688 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf790c-300a-462a-b846-0c247d326fc5 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:47.248432 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71bb33-114a-48fa-89ac-f88f8f54fc16 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:47.274967 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf790c-300a-462a-b846-0c247d326fc5 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:47.277201 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:47.283982 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f182f-93dc-424c-b95f-c84d5df1006e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:47.284618 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f182f-93dc-424c-b95f-c84d5df1006e None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:47.284897 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f182f-93dc-424c-b95f-c84d5df1006e None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:47.285171 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f182f-93dc-424c-b95f-c84d5df1006e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:47.295549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f182f-93dc-424c-b95f-c84d5df1006e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:47.296980 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f182f-93dc-424c-b95f-c84d5df1006e None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:47.309018 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00c090-5292-448d-9a80-aac17613f6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:47.309632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00c090-5292-448d-9a80-aac17613f6ed None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:47.312733 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00c090-5292-448d-9a80-aac17613f6ed None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:47.312733 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00c090-5292-448d-9a80-aac17613f6ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:47.312733 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00c090-5292-448d-9a80-aac17613f6ed None admin] RBAC: Adding query filter params (role.id=49069056c7b14e319599004c4af25dfb, scope.project.id=75313278ff3747909a57b6f37496d31e, user.id=f68b37524d7245e4b606ad8dd15442ef) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:47.312733 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00c090-5292-448d-9a80-aac17613f6ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:47.317745 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-094f182f-93dc-424c-b95f-c84d5df1006e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:47.317745 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:47.317745 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:47.317745 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:47.317745 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:47.317745 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:47.317745 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:47.317745 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:47.317745 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:47.317745 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:47.317745 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:47.317745 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:47.317745 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:47.317745 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:47.317745 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:47.319320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:47.319320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:47.319320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:47.319320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:47.319320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:47.319320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:47.319320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:47.319320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:47.319320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:47.319320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:47.319320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:47.319320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:47.319320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:47.319320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:47.319320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:47.319320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:47.319320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:47.320498 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:47.320498 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:47.320498 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:47.320498 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:47.320768 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00c090-5292-448d-9a80-aac17613f6ed None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:47.320857 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 318/609] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:47.320857 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f182f-93dc-424c-b95f-c84d5df1006e None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:47.321025 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 292/610] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:13:47 2022] GET /identity/v3/role_assignments?user.id=f68b37524d7245e4b606ad8dd15442ef&scope.project.id=75313278ff3747909a57b6f37496d31e&role.id=49069056c7b14e319599004c4af25dfb => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:47.321025 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00c090-5292-448d-9a80-aac17613f6ed None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:47.398989 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:47.440127 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00c090-5292-448d-9a80-aac17613f6ed None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:47.449739 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f182f-93dc-424c-b95f-c84d5df1006e None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:47.476424 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a3a78-fc13-4d7c-af9a-d68cfb69e74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:47.477098 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a3a78-fc13-4d7c-af9a-d68cfb69e74c None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:47.477378 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a3a78-fc13-4d7c-af9a-d68cfb69e74c None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:47.477653 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a3a78-fc13-4d7c-af9a-d68cfb69e74c None admin] PATH_INFO: `/v3/users/glance` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:47.485848 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a3a78-fc13-4d7c-af9a-d68cfb69e74c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:47.487342 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a3a78-fc13-4d7c-af9a-d68cfb69e74c None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:47.489026 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca471c-7893-4cf4-b22d-bd332e5b1dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:47.489673 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca471c-7893-4cf4-b22d-bd332e5b1dca None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:47.489949 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca471c-7893-4cf4-b22d-bd332e5b1dca None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:47.490222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca471c-7893-4cf4-b22d-bd332e5b1dca None admin] PATH_INFO: `/v3/roles/service` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:47.501624 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-dc9a3a78-fc13-4d7c-af9a-d68cfb69e74c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 20:13:47.501624 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:47.501624 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:47.501624 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:47.501624 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:47.501624 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:47.501624 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:47.501624 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:47.501624 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:47.501624 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:47.501624 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:47.501624 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:47.501624 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 20:13:47.501624 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 20:13:47.501624 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 20:13:47.501624 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 20:13:47.502786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:47.502786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:47.502786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 20:13:47.502786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:47.502786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 20:13:47.502786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:47.502786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:47.502786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:47.502786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:47.502786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:47.502786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:47.502786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:47.502786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:47.502786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:47.502786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:47.502786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:47.502786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:47.502786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:47.504007 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:47.504007 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:47.504007 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 20:13:47.504007 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 20:13:47.504007 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 20:13:47.504007 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 20:13:47.504007 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 20:13:47.504007 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 20:13:47.504007 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 20:13:47.504007 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:47.504547 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 293/611] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:47.505175 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a3a78-fc13-4d7c-af9a-d68cfb69e74c None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:47.505593 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca471c-7893-4cf4-b22d-bd332e5b1dca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:47.512377 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-b4ca471c-7893-4cf4-b22d-bd332e5b1dca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:13:47.512377 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:47.512377 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:47.512377 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:47.512377 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:47.512377 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:47.512377 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:47.512377 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:47.512377 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:47.512377 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:47.512377 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:47.512377 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:47.512377 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:47.512377 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:47.512377 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:47.512377 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:47.513490 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:47.513490 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:47.513490 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:47.513490 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:47.513490 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:47.513490 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:47.513490 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:47.513490 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:47.513490 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:47.513490 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:47.513490 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:47.513490 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:47.513490 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:47.513490 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:47.513490 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:47.513490 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:47.514509 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:47.514509 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:47.514509 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:47.514509 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:47.514509 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:47.514509 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:47.514509 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:47.514509 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:47.514509 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:47.514509 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:47.514509 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:13:47.514509 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:47.516844 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 319/612] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 27 20:13:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:47.517771 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca471c-7893-4cf4-b22d-bd332e5b1dca None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:47.567711 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:47.628920 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a3a78-fc13-4d7c-af9a-d68cfb69e74c None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:47.630040 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca471c-7893-4cf4-b22d-bd332e5b1dca None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:47.656555 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:47.666626 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dad1a2-871c-447f-8ceb-4e63224c67dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:47.667271 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dad1a2-871c-447f-8ceb-4e63224c67dd None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:47.667545 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dad1a2-871c-447f-8ceb-4e63224c67dd None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:47.667816 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dad1a2-871c-447f-8ceb-4e63224c67dd None admin] PATH_INFO: `/v3/users` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:47.668607 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dad1a2-871c-447f-8ceb-4e63224c67dd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:47.668773 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b54e7-1c68-4e4f-bbd4-86ec2e48fe75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:47.668904 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dad1a2-871c-447f-8ceb-4e63224c67dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:47.669566 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b54e7-1c68-4e4f-bbd4-86ec2e48fe75 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:47.670005 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b54e7-1c68-4e4f-bbd4-86ec2e48fe75 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:47.670334 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dad1a2-871c-447f-8ceb-4e63224c67dd None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:47.670420 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b54e7-1c68-4e4f-bbd4-86ec2e48fe75 None admin] PATH_INFO: `/v3/domains` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:47.671314 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b54e7-1c68-4e4f-bbd4-86ec2e48fe75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:47.671770 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b54e7-1c68-4e4f-bbd4-86ec2e48fe75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:47.673619 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b54e7-1c68-4e4f-bbd4-86ec2e48fe75 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:47.692044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 320/613] 10.222.0.83 () {56 vars in 1137 bytes} [Wed Jul 27 20:13:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:47.692044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dad1a2-871c-447f-8ceb-4e63224c67dd None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:47.692319 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 294/614] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:47.692319 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b54e7-1c68-4e4f-bbd4-86ec2e48fe75 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:47.796415 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b54e7-1c68-4e4f-bbd4-86ec2e48fe75 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:47.799638 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:47.803760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dad1a2-871c-447f-8ceb-4e63224c67dd None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:47.837617 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dec47-d2bb-4f54-988f-2836d4d63556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:47.838253 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dec47-d2bb-4f54-988f-2836d4d63556 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:47.838530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dec47-d2bb-4f54-988f-2836d4d63556 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:47.838800 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dec47-d2bb-4f54-988f-2836d4d63556 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:47.840589 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc39c4-048f-428c-855c-3d4389c14741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:47.841100 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc39c4-048f-428c-855c-3d4389c14741 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:47.841366 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc39c4-048f-428c-855c-3d4389c14741 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:47.841636 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc39c4-048f-428c-855c-3d4389c14741 None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:47.842490 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc39c4-048f-428c-855c-3d4389c14741 None admin] RBAC: Adding query filter params (name=service) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:47.842666 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc39c4-048f-428c-855c-3d4389c14741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:47.844032 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc39c4-048f-428c-855c-3d4389c14741 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:47.847212 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404dec47-d2bb-4f54-988f-2836d4d63556 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:47.848634 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404dec47-d2bb-4f54-988f-2836d4d63556 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:47.856965 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 321/615] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 27 20:13:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:47.856965 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc39c4-048f-428c-855c-3d4389c14741 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:47.860563 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-404dec47-d2bb-4f54-988f-2836d4d63556 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 20:13:47.860563 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:47.860563 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:47.860563 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:47.860563 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:47.860563 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:47.860563 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:47.860563 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:47.860563 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:47.860563 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:47.860563 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:47.860563 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:47.860563 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 20:13:47.860563 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 20:13:47.860563 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 20:13:47.860563 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 20:13:47.861543 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:47.861543 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:47.861543 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 20:13:47.861543 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:47.861543 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 20:13:47.861543 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:47.861543 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:47.861543 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:47.861543 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:47.861543 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:47.861543 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:47.861543 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:47.861543 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:47.861543 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:47.861543 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:47.861543 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:47.861543 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:47.861543 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:47.862499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:47.862499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:47.862499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 20:13:47.862499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 20:13:47.862499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 20:13:47.862499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 20:13:47.862499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 20:13:47.862499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 20:13:47.862499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 20:13:47.862499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:47.862499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 295/616] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:13:47.862499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dec47-d2bb-4f54-988f-2836d4d63556 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:47.915484 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:47.974169 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc39c4-048f-428c-855c-3d4389c14741 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:47.978410 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dec47-d2bb-4f54-988f-2836d4d63556 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:48.009993 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d278ca5-5069-4495-850b-c96261a000c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:48.010601 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d278ca5-5069-4495-850b-c96261a000c3 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:48.010883 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d278ca5-5069-4495-850b-c96261a000c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:48.011277 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d278ca5-5069-4495-850b-c96261a000c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:48.022016 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8c7ae-d062-469d-86ba-834179ce9163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:48.023328 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8c7ae-d062-469d-86ba-834179ce9163 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:48.024104 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8c7ae-d062-469d-86ba-834179ce9163 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:48.024581 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8c7ae-d062-469d-86ba-834179ce9163 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:48.039615 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8c7ae-d062-469d-86ba-834179ce9163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:48.040544 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:48.042004 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8c7ae-d062-469d-86ba-834179ce9163 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:48.059219 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-75e8c7ae-d062-469d-86ba-834179ce9163 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:48.059219 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:48.059219 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:48.059219 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:48.059219 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:48.059219 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:48.059219 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:48.059219 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:48.059219 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:48.059219 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:48.059219 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:48.059219 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:48.059219 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:48.059219 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:48.059219 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:48.060141 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:48.060141 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:48.060141 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:48.060141 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:48.060141 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:48.060141 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:48.060141 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:48.060141 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:48.060141 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:48.060141 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:48.060141 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:48.060141 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:48.060141 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:48.060141 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:48.060141 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:48.060141 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:48.060141 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:48.061039 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:48.061039 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:48.061039 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:48.061039 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:48.062919 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 296/617] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:48.063955 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8c7ae-d062-469d-86ba-834179ce9163 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:48.088072 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d278ca5-5069-4495-850b-c96261a000c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:48.089771 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d278ca5-5069-4495-850b-c96261a000c3 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:48.164063 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:48.172322 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8c7ae-d062-469d-86ba-834179ce9163 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:48.198433 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 322/618] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:13:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:48.199688 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d278ca5-5069-4495-850b-c96261a000c3 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:48.215429 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ecd97d-21a0-4e82-9639-f6dc3935b7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:48.216296 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ecd97d-21a0-4e82-9639-f6dc3935b7bb None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:48.216756 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ecd97d-21a0-4e82-9639-f6dc3935b7bb None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:48.217331 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ecd97d-21a0-4e82-9639-f6dc3935b7bb None admin] PATH_INFO: `/v3/users` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:48.218413 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ecd97d-21a0-4e82-9639-f6dc3935b7bb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:48.218897 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ecd97d-21a0-4e82-9639-f6dc3935b7bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:48.220620 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ecd97d-21a0-4e82-9639-f6dc3935b7bb None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:48.239273 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 297/619] 10.222.0.83 () {56 vars in 1137 bytes} [Wed Jul 27 20:13:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:48.240206 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ecd97d-21a0-4e82-9639-f6dc3935b7bb None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:48.265788 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:48.310441 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d278ca5-5069-4495-850b-c96261a000c3 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:48.350547 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c56d2-0cde-4965-908d-bfe06a0b1f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:48.351809 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c56d2-0cde-4965-908d-bfe06a0b1f8d None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:48.352329 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c56d2-0cde-4965-908d-bfe06a0b1f8d None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:48.352817 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c56d2-0cde-4965-908d-bfe06a0b1f8d None admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:48.353130 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ecd97d-21a0-4e82-9639-f6dc3935b7bb None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:48.353915 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c56d2-0cde-4965-908d-bfe06a0b1f8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:48.354543 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c56d2-0cde-4965-908d-bfe06a0b1f8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:48.355923 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c56d2-0cde-4965-908d-bfe06a0b1f8d None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:48.367749 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 323/620] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:48.368521 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c56d2-0cde-4965-908d-bfe06a0b1f8d None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:48.394655 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860424f-e98d-484a-819e-5b8240d59038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:48.395332 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860424f-e98d-484a-819e-5b8240d59038 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:48.395611 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860424f-e98d-484a-819e-5b8240d59038 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:48.396055 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860424f-e98d-484a-819e-5b8240d59038 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:48.408112 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7860424f-e98d-484a-819e-5b8240d59038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:48.409551 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7860424f-e98d-484a-819e-5b8240d59038 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:48.425052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-7860424f-e98d-484a-819e-5b8240d59038 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:48.425052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:48.425052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:48.425052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:48.425052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:48.425052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:48.425052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:48.425052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:48.425052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:48.425052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:48.425052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:48.425052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:48.425052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:48.425052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:48.425052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:48.425947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:48.425947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:48.425947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:48.425947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:48.425947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:48.425947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:48.425947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:48.425947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:48.425947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:48.425947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:48.425947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:48.425947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:48.425947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:48.425947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:48.425947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:48.425947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:48.425947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:48.426832 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:48.426832 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:48.426832 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:48.426832 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:48.426832 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 298/621] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:48.427129 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860424f-e98d-484a-819e-5b8240d59038 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:48.443221 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:48.480195 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c56d2-0cde-4965-908d-bfe06a0b1f8d None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:48.511417 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:48.522915 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8915ac-2400-413d-807a-1461442d6040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:48.523567 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8915ac-2400-413d-807a-1461442d6040 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:48.523853 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8915ac-2400-413d-807a-1461442d6040 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:48.524155 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8915ac-2400-413d-807a-1461442d6040 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:48.547915 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860424f-e98d-484a-819e-5b8240d59038 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:48.583326 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f1adb-8074-4b7c-adfb-21be78d66eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:48.583968 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f1adb-8074-4b7c-adfb-21be78d66eff None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:48.584766 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f1adb-8074-4b7c-adfb-21be78d66eff None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:48.585051 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f1adb-8074-4b7c-adfb-21be78d66eff None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:48.592630 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f1adb-8074-4b7c-adfb-21be78d66eff None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:48.594067 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f1adb-8074-4b7c-adfb-21be78d66eff None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:48.595471 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8915ac-2400-413d-807a-1461442d6040 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:48.596945 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8915ac-2400-413d-807a-1461442d6040 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:48.606095 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-922f1adb-8074-4b7c-adfb-21be78d66eff None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 20:13:48.606095 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:48.606095 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:48.606095 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:48.606095 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:48.606095 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:48.606095 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:48.606095 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:48.606095 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:48.606095 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:48.606095 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:48.606095 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:48.606095 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 20:13:48.606095 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 20:13:48.606095 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 20:13:48.606095 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 20:13:48.607046 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:48.607046 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:48.607046 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 20:13:48.607046 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:48.607046 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 20:13:48.607046 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:48.607046 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:48.607046 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:48.607046 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:48.607046 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:48.607046 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:48.607046 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:48.607046 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:48.607046 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:48.607046 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:48.607046 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:48.607046 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:48.607046 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:48.608100 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:48.608100 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:48.608100 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 20:13:48.608100 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 20:13:48.608100 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 20:13:48.608100 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 20:13:48.608100 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 20:13:48.608100 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 20:13:48.608100 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 20:13:48.608100 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:48.608100 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 299/622] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 27 20:13:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:48.608100 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f1adb-8074-4b7c-adfb-21be78d66eff None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:48.679032 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:48.706700 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 324/623] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:13:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:48.708358 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8915ac-2400-413d-807a-1461442d6040 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:48.716628 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f1adb-8074-4b7c-adfb-21be78d66eff None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:48.735341 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:48.755676 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84c633-e38f-4292-a4f2-75154f28036f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:48.756363 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84c633-e38f-4292-a4f2-75154f28036f None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:48.756613 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84c633-e38f-4292-a4f2-75154f28036f None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:48.756887 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84c633-e38f-4292-a4f2-75154f28036f None admin] PATH_INFO: `/v3/domains` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:48.758896 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84c633-e38f-4292-a4f2-75154f28036f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:48.758896 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84c633-e38f-4292-a4f2-75154f28036f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:48.759252 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84c633-e38f-4292-a4f2-75154f28036f None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:48.772826 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 300/624] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:48.774027 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84c633-e38f-4292-a4f2-75154f28036f None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:48.821583 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8915ac-2400-413d-807a-1461442d6040 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:48.857627 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9247c4e-1d50-4c29-9bcf-57be92174f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:48.858910 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9247c4e-1d50-4c29-9bcf-57be92174f0a None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:48.859370 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9247c4e-1d50-4c29-9bcf-57be92174f0a None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:48.859811 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9247c4e-1d50-4c29-9bcf-57be92174f0a None admin] PATH_INFO: `/v3/users` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:48.860727 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9247c4e-1d50-4c29-9bcf-57be92174f0a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:48.861179 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9247c4e-1d50-4c29-9bcf-57be92174f0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:48.862760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9247c4e-1d50-4c29-9bcf-57be92174f0a None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:48.880443 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 325/625] 10.222.0.83 () {56 vars in 1139 bytes} [Wed Jul 27 20:13:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:48.880443 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9247c4e-1d50-4c29-9bcf-57be92174f0a None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:48.885512 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84c633-e38f-4292-a4f2-75154f28036f None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:48.912096 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:48.922384 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf18a7f-2891-4b63-baec-732ae6d86c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:48.923029 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf18a7f-2891-4b63-baec-732ae6d86c3a None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:48.923344 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf18a7f-2891-4b63-baec-732ae6d86c3a None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:48.923621 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf18a7f-2891-4b63-baec-732ae6d86c3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:48.936840 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf18a7f-2891-4b63-baec-732ae6d86c3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:48.938218 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf18a7f-2891-4b63-baec-732ae6d86c3a None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:48.953296 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-9cf18a7f-2891-4b63-baec-732ae6d86c3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:48.953296 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:48.953296 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:48.953296 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:48.953296 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:48.953296 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:48.953296 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:48.953296 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:48.953296 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:48.953296 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:48.953296 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:48.953296 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:48.953296 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:48.953296 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:48.953296 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:48.954454 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:48.954454 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:48.954454 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:48.954454 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:48.954454 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:48.954454 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:48.954454 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:48.954454 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:48.954454 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:48.954454 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:48.954454 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:48.954454 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:48.954454 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:48.954454 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:48.954454 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:48.954454 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:48.954454 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:48.955394 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:48.955394 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:48.955394 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:48.955394 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:48.955394 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 301/626] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:48.955677 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf18a7f-2891-4b63-baec-732ae6d86c3a None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:48.979485 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:49.001128 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9247c4e-1d50-4c29-9bcf-57be92174f0a None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:49.036574 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7587503-7a86-4f6b-a948-4e34507aaa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:49.037210 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7587503-7a86-4f6b-a948-4e34507aaa2c None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:49.037513 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7587503-7a86-4f6b-a948-4e34507aaa2c None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:49.037793 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7587503-7a86-4f6b-a948-4e34507aaa2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:49.048119 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7587503-7a86-4f6b-a948-4e34507aaa2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:49.049641 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7587503-7a86-4f6b-a948-4e34507aaa2c None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:49.061779 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-f7587503-7a86-4f6b-a948-4e34507aaa2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:49.061779 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:49.061779 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:49.061779 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:49.061779 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:49.061779 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:49.061779 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:49.061779 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:49.061779 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:49.061779 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:49.061779 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:49.061779 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:49.061779 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 20:13:49.061779 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 20:13:49.061779 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 20:13:49.062670 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 20:13:49.062670 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:49.062670 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:49.062670 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:49.062670 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:49.062670 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:49.062670 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:49.062670 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:49.062670 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:49.062670 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:49.062670 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:49.062670 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:49.062670 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:49.062670 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:49.062670 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:49.062670 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:49.062670 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:49.063941 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 20:13:49.063941 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 20:13:49.063941 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 20:13:49.063941 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 20:13:49.063941 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 20:13:49.063941 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 20:13:49.063941 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:49.063941 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:49.063941 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 326/627] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:13:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:49.063941 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7587503-7a86-4f6b-a948-4e34507aaa2c None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:49.073412 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf18a7f-2891-4b63-baec-732ae6d86c3a None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:49.109056 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c9def-6796-4565-97d0-b3c85494d4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:49.109676 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c9def-6796-4565-97d0-b3c85494d4bf None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:49.109962 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c9def-6796-4565-97d0-b3c85494d4bf None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:49.110347 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c9def-6796-4565-97d0-b3c85494d4bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:49.160306 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:49.169235 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7587503-7a86-4f6b-a948-4e34507aaa2c None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:49.188464 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c9def-6796-4565-97d0-b3c85494d4bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:49.190123 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c9def-6796-4565-97d0-b3c85494d4bf None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:49.205019 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcad31-78a8-44a5-b8f1-989a37699c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:49.205629 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcad31-78a8-44a5-b8f1-989a37699c82 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:49.205899 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcad31-78a8-44a5-b8f1-989a37699c82 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:49.206170 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcad31-78a8-44a5-b8f1-989a37699c82 None admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:49.206844 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcad31-78a8-44a5-b8f1-989a37699c82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:49.207163 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcad31-78a8-44a5-b8f1-989a37699c82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:49.208511 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcad31-78a8-44a5-b8f1-989a37699c82 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:49.217166 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:49.220699 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 327/628] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:49.221770 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcad31-78a8-44a5-b8f1-989a37699c82 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:49.314043 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 302/629] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:13:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:49.315494 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c9def-6796-4565-97d0-b3c85494d4bf None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:49.330432 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcad31-78a8-44a5-b8f1-989a37699c82 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:49.365102 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60a39c-6d5c-48d2-814e-544d166cafec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:49.366541 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60a39c-6d5c-48d2-814e-544d166cafec None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:49.366810 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60a39c-6d5c-48d2-814e-544d166cafec None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:49.367090 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60a39c-6d5c-48d2-814e-544d166cafec None admin] PATH_INFO: `/v3/projects` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:49.367838 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60a39c-6d5c-48d2-814e-544d166cafec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:49.368139 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60a39c-6d5c-48d2-814e-544d166cafec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:49.369550 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60a39c-6d5c-48d2-814e-544d166cafec None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:49.382362 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 328/630] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 27 20:13:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:49.382981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60a39c-6d5c-48d2-814e-544d166cafec None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:49.407015 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:49.432451 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c9def-6796-4565-97d0-b3c85494d4bf None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:49.447113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:49.471364 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53e438-c640-4038-ac13-012399cad0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:49.472180 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53e438-c640-4038-ac13-012399cad0bb None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:49.472465 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53e438-c640-4038-ac13-012399cad0bb None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:49.472743 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53e438-c640-4038-ac13-012399cad0bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:49.479538 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53e438-c640-4038-ac13-012399cad0bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:49.480982 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53e438-c640-4038-ac13-012399cad0bb None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:49.488947 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60a39c-6d5c-48d2-814e-544d166cafec None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:49.493616 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-bf53e438-c640-4038-ac13-012399cad0bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:49.493616 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:49.493616 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:49.493616 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:49.493616 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:49.493616 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:49.493616 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:49.493616 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:49.493616 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:49.493616 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:49.493616 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:49.493616 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:49.493616 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 20:13:49.493616 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 20:13:49.493616 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 20:13:49.494608 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 20:13:49.494608 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:49.494608 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:49.494608 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:49.494608 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:49.494608 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:49.494608 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:49.494608 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:49.494608 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:49.494608 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:49.494608 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:49.494608 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:49.494608 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:49.494608 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:49.494608 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:49.494608 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:49.494608 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:49.495532 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 20:13:49.495532 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 20:13:49.495532 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 20:13:49.495532 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 20:13:49.495532 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 20:13:49.495532 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 20:13:49.495532 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:49.495532 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:49.495532 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 303/631] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:13:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:49.496621 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53e438-c640-4038-ac13-012399cad0bb None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:49.533242 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02608f20-36f9-4d40-a2d8-fc0d866dc10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:49.533880 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02608f20-36f9-4d40-a2d8-fc0d866dc10b None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:49.534159 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02608f20-36f9-4d40-a2d8-fc0d866dc10b None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:49.534429 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02608f20-36f9-4d40-a2d8-fc0d866dc10b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:49.544877 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02608f20-36f9-4d40-a2d8-fc0d866dc10b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:49.546322 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02608f20-36f9-4d40-a2d8-fc0d866dc10b None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:49.562135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-02608f20-36f9-4d40-a2d8-fc0d866dc10b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:49.562135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:49.562135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:49.562135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:49.562135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:49.562135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:49.562135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:49.562135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:49.562135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:49.562135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:49.562135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:49.562135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:49.562135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:49.562135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:49.562135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:49.563036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:49.563036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:49.563036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:49.563036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:49.563036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:49.563036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:49.563036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:49.563036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:49.563036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:49.563036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:49.563036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:49.563036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:49.563036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:49.563036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:49.563036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:49.563036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:49.563036 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:49.563970 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:49.563970 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:49.563970 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:49.563970 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:49.563970 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 329/632] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:49.564685 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02608f20-36f9-4d40-a2d8-fc0d866dc10b None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:49.607183 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53e438-c640-4038-ac13-012399cad0bb None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:49.643381 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ae56a-3fc7-43af-800a-b37c7b9cd82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:49.644089 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ae56a-3fc7-43af-800a-b37c7b9cd82e None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:49.644437 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ae56a-3fc7-43af-800a-b37c7b9cd82e None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:49.644777 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ae56a-3fc7-43af-800a-b37c7b9cd82e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:49.645637 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ae56a-3fc7-43af-800a-b37c7b9cd82e None admin] RBAC: Adding query filter params (role.id=49069056c7b14e319599004c4af25dfb, scope.project.id=75313278ff3747909a57b6f37496d31e, user.id=04dc74146aed49cb98441ea945847379) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:49.646014 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ae56a-3fc7-43af-800a-b37c7b9cd82e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:49.647579 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ae56a-3fc7-43af-800a-b37c7b9cd82e None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:49.653550 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 304/633] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:13:49 2022] GET /identity/v3/role_assignments?user.id=04dc74146aed49cb98441ea945847379&scope.project.id=75313278ff3747909a57b6f37496d31e&role.id=49069056c7b14e319599004c4af25dfb => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:49.654398 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ae56a-3fc7-43af-800a-b37c7b9cd82e None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:49.663445 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:49.676432 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02608f20-36f9-4d40-a2d8-fc0d866dc10b None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:49.691444 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:49.719665 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34578b4-5ade-42ea-925c-c23d450d6d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:49.720622 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34578b4-5ade-42ea-925c-c23d450d6d28 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:49.721477 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34578b4-5ade-42ea-925c-c23d450d6d28 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:49.721477 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34578b4-5ade-42ea-925c-c23d450d6d28 None admin] PATH_INFO: `/v3/projects` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:49.721931 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34578b4-5ade-42ea-925c-c23d450d6d28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:49.722254 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34578b4-5ade-42ea-925c-c23d450d6d28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:49.723762 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34578b4-5ade-42ea-925c-c23d450d6d28 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:49.737819 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 330/634] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 27 20:13:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:49.739364 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6c3fc-e6bf-4abe-a288-1a49fe33c093 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:49.739547 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6c3fc-e6bf-4abe-a288-1a49fe33c093 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:49.739829 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6c3fc-e6bf-4abe-a288-1a49fe33c093 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:49.741809 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 331/635] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:49.746823 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6c3fc-e6bf-4abe-a288-1a49fe33c093 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:49.782215 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ae56a-3fc7-43af-800a-b37c7b9cd82e None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:49.821306 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f712266-5b66-47a5-915f-1df26879b0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:49.821943 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f712266-5b66-47a5-915f-1df26879b0dd None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:49.822224 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f712266-5b66-47a5-915f-1df26879b0dd None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:49.822500 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f712266-5b66-47a5-915f-1df26879b0dd None admin] PATH_INFO: `/v3/domains` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:49.823239 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f712266-5b66-47a5-915f-1df26879b0dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:49.823553 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f712266-5b66-47a5-915f-1df26879b0dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:49.825034 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f712266-5b66-47a5-915f-1df26879b0dd None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:49.840229 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 305/636] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:49.841627 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69184758-7862-47c1-8816-3a13e7a715b8 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:49.841921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69184758-7862-47c1-8816-3a13e7a715b8 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:49.842195 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69184758-7862-47c1-8816-3a13e7a715b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:49.860844 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-69184758-7862-47c1-8816-3a13e7a715b8 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:49.861670 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6c3fc-e6bf-4abe-a288-1a49fe33c093 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:49.862119 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-69184758-7862-47c1-8816-3a13e7a715b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:49.903340 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e98f2a-f3f6-496a-bd7f-4028cc5020ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:49.903954 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e98f2a-f3f6-496a-bd7f-4028cc5020ce None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:49.904608 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e98f2a-f3f6-496a-bd7f-4028cc5020ce None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:49.904608 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e98f2a-f3f6-496a-bd7f-4028cc5020ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:49.905317 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e98f2a-f3f6-496a-bd7f-4028cc5020ce None admin] RBAC: Adding query filter params (role.id=49069056c7b14e319599004c4af25dfb, scope.project.id=75313278ff3747909a57b6f37496d31e, user.id=4bf3f75970b342609acb2542913b068d) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:49.905626 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e98f2a-f3f6-496a-bd7f-4028cc5020ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:49.907113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e98f2a-f3f6-496a-bd7f-4028cc5020ce None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:49.913836 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 332/637] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:13:49 2022] GET /identity/v3/role_assignments?user.id=4bf3f75970b342609acb2542913b068d&scope.project.id=75313278ff3747909a57b6f37496d31e&role.id=49069056c7b14e319599004c4af25dfb => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:49.914716 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e98f2a-f3f6-496a-bd7f-4028cc5020ce None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:49.932483 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:49.945390 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 306/638] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:49.962186 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:49.971456 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69184758-7862-47c1-8816-3a13e7a715b8 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:50.054672 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e98f2a-f3f6-496a-bd7f-4028cc5020ce None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:50.102454 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482448da-3456-4a37-8423-316abd157aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:50.102871 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482448da-3456-4a37-8423-316abd157aa4 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:50.103205 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482448da-3456-4a37-8423-316abd157aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:50.103476 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482448da-3456-4a37-8423-316abd157aa4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:50.114889 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482448da-3456-4a37-8423-316abd157aa4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:50.114889 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482448da-3456-4a37-8423-316abd157aa4 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:50.122009 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69184758-7862-47c1-8816-3a13e7a715b8 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:50.126437 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-482448da-3456-4a37-8423-316abd157aa4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:50.126437 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:50.126437 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:50.126437 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:50.126437 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:50.126437 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:50.126437 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:50.126437 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:50.126437 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:50.126437 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:50.126437 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:50.126437 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:50.126437 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 20:13:50.126437 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 20:13:50.126437 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 20:13:50.127395 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 20:13:50.127395 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:50.127395 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:50.127395 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:50.127395 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:50.127395 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:50.127395 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:50.127395 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:50.127395 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:50.127395 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:50.127395 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:50.127395 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:50.127395 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:50.127395 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:50.127395 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:50.127395 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:50.127395 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:50.128328 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 20:13:50.128328 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 20:13:50.128328 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 20:13:50.128328 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 20:13:50.128328 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 20:13:50.128328 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 20:13:50.128328 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:50.128328 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:50.128946 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 333/639] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:13:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:50.134197 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482448da-3456-4a37-8423-316abd157aa4 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:50.166365 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fc6a4-7bd8-40c2-a45d-2fa4a67d3613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:50.167047 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fc6a4-7bd8-40c2-a45d-2fa4a67d3613 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:50.167395 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fc6a4-7bd8-40c2-a45d-2fa4a67d3613 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:50.167675 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fc6a4-7bd8-40c2-a45d-2fa4a67d3613 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:50.184763 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653fc6a4-7bd8-40c2-a45d-2fa4a67d3613 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:50.190943 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-653fc6a4-7bd8-40c2-a45d-2fa4a67d3613 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:13:50.190943 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:50.190943 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:50.190943 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:50.190943 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:50.190943 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:50.190943 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:50.190943 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:50.190943 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:50.190943 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:50.190943 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:50.190943 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:50.190943 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:50.190943 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:50.190943 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:50.190943 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:50.192225 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:50.192225 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:50.192225 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:50.192225 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:50.192225 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:50.192225 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:50.192225 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:50.192225 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:50.192225 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:50.192225 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:50.192225 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:50.192225 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:50.192225 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:50.192225 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:50.192225 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:50.192225 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:50.193700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:50.193700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:50.193700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:50.193700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:50.193700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:50.193700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:50.193700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:50.193700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:50.193700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:50.193700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:50.193700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:13:50.193700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:50.193700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 307/640] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 27 20:13:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:50.198215 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fc6a4-7bd8-40c2-a45d-2fa4a67d3613 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:50.249172 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:50.255238 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:50.255835 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482448da-3456-4a37-8423-316abd157aa4 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:50.296956 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70b6f6-f7a8-4abe-a965-5b7ba3363926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:50.297644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70b6f6-f7a8-4abe-a965-5b7ba3363926 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:50.297929 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70b6f6-f7a8-4abe-a965-5b7ba3363926 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:50.298198 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70b6f6-f7a8-4abe-a965-5b7ba3363926 None admin] PATH_INFO: `/v3/projects` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:50.298933 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70b6f6-f7a8-4abe-a965-5b7ba3363926 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:50.299454 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70b6f6-f7a8-4abe-a965-5b7ba3363926 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:50.300886 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70b6f6-f7a8-4abe-a965-5b7ba3363926 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:50.331162 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 334/641] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 27 20:13:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:50.333846 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70b6f6-f7a8-4abe-a965-5b7ba3363926 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:50.342191 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fc6a4-7bd8-40c2-a45d-2fa4a67d3613 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:50.379245 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cef0c-bf46-4cef-a945-3442de09924a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:50.380216 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cef0c-bf46-4cef-a945-3442de09924a None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:50.380725 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cef0c-bf46-4cef-a945-3442de09924a None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:50.381233 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cef0c-bf46-4cef-a945-3442de09924a None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:50.382169 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190cef0c-bf46-4cef-a945-3442de09924a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:50.382677 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190cef0c-bf46-4cef-a945-3442de09924a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:50.384266 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190cef0c-bf46-4cef-a945-3442de09924a None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:50.398558 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 308/642] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:50.399851 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cef0c-bf46-4cef-a945-3442de09924a None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:50.441485 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70b6f6-f7a8-4abe-a965-5b7ba3363926 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:50.479683 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879157a0-36d3-456b-a353-60677449d3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:50.480688 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879157a0-36d3-456b-a353-60677449d3f5 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:50.481174 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879157a0-36d3-456b-a353-60677449d3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:50.481651 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879157a0-36d3-456b-a353-60677449d3f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:50.483212 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879157a0-36d3-456b-a353-60677449d3f5 None admin] RBAC: Adding query filter params (role.id=49069056c7b14e319599004c4af25dfb, scope.project.id=75313278ff3747909a57b6f37496d31e, user.id=308f029a3e7b46fbaff75a01720c8986) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:50.483737 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879157a0-36d3-456b-a353-60677449d3f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:50.486241 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879157a0-36d3-456b-a353-60677449d3f5 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:50.499684 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 335/643] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:13:50 2022] GET /identity/v3/role_assignments?user.id=308f029a3e7b46fbaff75a01720c8986&scope.project.id=75313278ff3747909a57b6f37496d31e&role.id=49069056c7b14e319599004c4af25dfb => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:50.515770 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cef0c-bf46-4cef-a945-3442de09924a None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:50.532657 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:50.555698 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbadacf-c91b-4323-9f44-ddbd1783b2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:50.556351 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbadacf-c91b-4323-9f44-ddbd1783b2c7 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:50.556634 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbadacf-c91b-4323-9f44-ddbd1783b2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:50.556906 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbadacf-c91b-4323-9f44-ddbd1783b2c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:50.569537 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbadacf-c91b-4323-9f44-ddbd1783b2c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:50.571106 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbadacf-c91b-4323-9f44-ddbd1783b2c7 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:50.587855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-ddbadacf-c91b-4323-9f44-ddbd1783b2c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:50.587855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:50.587855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:50.587855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:50.587855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:50.587855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:50.587855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:50.587855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:50.587855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:50.587855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:50.587855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:50.587855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:50.587855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:50.587855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:50.587855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:50.588845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:50.588845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:50.588845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:50.588845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:50.588845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:50.588845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:50.588845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:50.588845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:50.588845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:50.588845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:50.588845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:50.588845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:50.588845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:50.588845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:50.588845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:50.588845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:50.588845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:50.589732 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:50.589732 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:50.589732 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:50.589732 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:50.589732 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 309/644] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:13:50.598963 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879157a0-36d3-456b-a353-60677449d3f5 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:50.624350 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:50.714116 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879157a0-36d3-456b-a353-60677449d3f5 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:50.749570 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864e89d-2a7b-4ec0-b6b7-fa390a6ac3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:50.750885 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864e89d-2a7b-4ec0-b6b7-fa390a6ac3cc None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:50.751391 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864e89d-2a7b-4ec0-b6b7-fa390a6ac3cc None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:50.751871 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864e89d-2a7b-4ec0-b6b7-fa390a6ac3cc None admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:50.752756 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864e89d-2a7b-4ec0-b6b7-fa390a6ac3cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:50.753263 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864e89d-2a7b-4ec0-b6b7-fa390a6ac3cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:50.754839 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864e89d-2a7b-4ec0-b6b7-fa390a6ac3cc None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:50.768316 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 336/645] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:50.774561 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbadacf-c91b-4323-9f44-ddbd1783b2c7 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:50.887189 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbadacf-c91b-4323-9f44-ddbd1783b2c7 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:50.925086 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359efdd3-ba54-4729-b637-287e7e813790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:50.926237 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359efdd3-ba54-4729-b637-287e7e813790 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:50.926723 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359efdd3-ba54-4729-b637-287e7e813790 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:50.927231 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359efdd3-ba54-4729-b637-287e7e813790 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:50.936048 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359efdd3-ba54-4729-b637-287e7e813790 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:50.938141 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359efdd3-ba54-4729-b637-287e7e813790 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:50.950571 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-359efdd3-ba54-4729-b637-287e7e813790 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 20:13:50.950571 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:50.950571 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:50.950571 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:50.950571 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:50.950571 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:50.950571 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:50.950571 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:50.950571 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:50.950571 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:50.950571 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:50.950571 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:50.950571 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 20:13:50.950571 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 20:13:50.950571 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 20:13:50.950571 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 20:13:50.951533 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:50.951533 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:50.951533 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 20:13:50.951533 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:50.951533 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 20:13:50.951533 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:50.951533 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:50.951533 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:50.951533 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:50.951533 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:50.951533 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:50.951533 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:50.951533 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:50.951533 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:50.951533 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:50.951533 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:50.951533 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:50.951533 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:50.952478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:50.952478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:50.952478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 20:13:50.952478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 20:13:50.952478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 20:13:50.952478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 20:13:50.952478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 20:13:50.952478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 20:13:50.952478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 20:13:50.952478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:50.955005 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 310/646] 10.222.0.83 () {56 vars in 1093 bytes} [Wed Jul 27 20:13:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:50.960900 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864e89d-2a7b-4ec0-b6b7-fa390a6ac3cc None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:51.047571 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:51.070015 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864e89d-2a7b-4ec0-b6b7-fa390a6ac3cc None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:51.109153 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b302bd-6acb-4261-aa5f-a9dc048745b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:51.110119 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b302bd-6acb-4261-aa5f-a9dc048745b3 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:51.110680 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b302bd-6acb-4261-aa5f-a9dc048745b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:51.111180 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b302bd-6acb-4261-aa5f-a9dc048745b3 None admin] PATH_INFO: `/v3/users` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:51.112172 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b302bd-6acb-4261-aa5f-a9dc048745b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:51.112711 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b302bd-6acb-4261-aa5f-a9dc048745b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:51.114350 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b302bd-6acb-4261-aa5f-a9dc048745b3 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:51.134493 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 337/647] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Jul 27 20:13:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:51.140451 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359efdd3-ba54-4729-b637-287e7e813790 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:51.174316 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:51.252765 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359efdd3-ba54-4729-b637-287e7e813790 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:51.287752 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690ad87-8944-49e1-98d2-3e48fd8a42b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:51.288729 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690ad87-8944-49e1-98d2-3e48fd8a42b1 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:51.289256 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690ad87-8944-49e1-98d2-3e48fd8a42b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:51.289777 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690ad87-8944-49e1-98d2-3e48fd8a42b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:51.365277 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690ad87-8944-49e1-98d2-3e48fd8a42b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:51.367268 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690ad87-8944-49e1-98d2-3e48fd8a42b1 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:51.394494 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:51.469335 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 311/648] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:13:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 20:13:51.475780 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b302bd-6acb-4261-aa5f-a9dc048745b3 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:51.579817 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b302bd-6acb-4261-aa5f-a9dc048745b3 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:51.616307 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac67c1e-3b05-4da2-972e-ab740d1e64b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:51.617248 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac67c1e-3b05-4da2-972e-ab740d1e64b8 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:51.617689 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac67c1e-3b05-4da2-972e-ab740d1e64b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:51.618121 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac67c1e-3b05-4da2-972e-ab740d1e64b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:51.625374 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:51.630171 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac67c1e-3b05-4da2-972e-ab740d1e64b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:51.631962 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac67c1e-3b05-4da2-972e-ab740d1e64b8 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:51.648551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-8ac67c1e-3b05-4da2-972e-ab740d1e64b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:51.648551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:51.648551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:51.648551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:51.648551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:51.648551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:51.648551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:51.648551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:51.648551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:51.648551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:51.648551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:51.648551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:51.648551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:51.648551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:51.648551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:51.649679 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:51.649679 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:51.649679 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:51.649679 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:51.649679 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:51.649679 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:51.649679 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:51.649679 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:51.649679 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:51.649679 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:51.649679 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:51.649679 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:51.649679 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:51.649679 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:51.649679 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:51.649679 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:51.649679 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:51.650769 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:51.650769 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:51.650769 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:51.650769 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:51.652665 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 338/649] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:51.658302 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690ad87-8944-49e1-98d2-3e48fd8a42b1 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:51.764732 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690ad87-8944-49e1-98d2-3e48fd8a42b1 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:51.794641 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:51.803802 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c6752-7232-4465-a065-f64094b5ded3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:51.804814 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c6752-7232-4465-a065-f64094b5ded3 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:51.805252 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c6752-7232-4465-a065-f64094b5ded3 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:51.805850 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c6752-7232-4465-a065-f64094b5ded3 None admin] PATH_INFO: `/v3/domains` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:51.806693 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c6752-7232-4465-a065-f64094b5ded3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:51.807246 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c6752-7232-4465-a065-f64094b5ded3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:51.808955 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c6752-7232-4465-a065-f64094b5ded3 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:51.821798 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 312/650] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:51.827607 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac67c1e-3b05-4da2-972e-ab740d1e64b8 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:51.940046 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac67c1e-3b05-4da2-972e-ab740d1e64b8 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:51.976750 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c53fa4-7d32-4e7e-8d3f-faa563ecf15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:51.978102 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c53fa4-7d32-4e7e-8d3f-faa563ecf15e None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:51.978535 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c53fa4-7d32-4e7e-8d3f-faa563ecf15e None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:51.978957 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c53fa4-7d32-4e7e-8d3f-faa563ecf15e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:51.986046 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c53fa4-7d32-4e7e-8d3f-faa563ecf15e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:51.987679 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c53fa4-7d32-4e7e-8d3f-faa563ecf15e None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:51.999423 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-71c53fa4-7d32-4e7e-8d3f-faa563ecf15e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:51.999423 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:51.999423 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:51.999423 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:51.999423 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:51.999423 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:51.999423 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:51.999423 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:51.999423 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:51.999423 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:51.999423 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:51.999423 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:51.999423 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 20:13:51.999423 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 20:13:51.999423 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 20:13:52.000763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 20:13:52.000763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:52.000763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:52.000763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:52.000763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:52.000763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:52.000763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:52.000763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:52.000763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:52.000763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:52.000763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:52.000763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:52.000763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:52.000763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:52.000763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:52.000763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:52.000763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:52.001885 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 20:13:52.001885 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 20:13:52.001885 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 20:13:52.001885 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 20:13:52.001885 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 20:13:52.001885 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 20:13:52.001885 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:52.001885 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:52.003866 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 339/651] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:13:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:52.010509 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c6752-7232-4465-a065-f64094b5ded3 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:52.019648 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3abc71-0db4-44ac-85fe-24c98edc6483 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:52.019944 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3abc71-0db4-44ac-85fe-24c98edc6483 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:52.020226 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3abc71-0db4-44ac-85fe-24c98edc6483 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:52.022276 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 340/652] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:52.028554 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cc711-dcd2-42e5-b7d8-ba3899b4e224 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:52.028803 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cc711-dcd2-42e5-b7d8-ba3899b4e224 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:52.029062 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cc711-dcd2-42e5-b7d8-ba3899b4e224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:52.051654 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-804cc711-dcd2-42e5-b7d8-ba3899b4e224 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:52.052936 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-804cc711-dcd2-42e5-b7d8-ba3899b4e224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:52.106446 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:52.141422 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c6752-7232-4465-a065-f64094b5ded3 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:52.145694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 341/653] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 20:13:52.169732 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cc711-dcd2-42e5-b7d8-ba3899b4e224 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:52.183386 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea818573-8c5c-498d-a03b-94a533cb06bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:52.184421 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea818573-8c5c-498d-a03b-94a533cb06bc None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:52.185236 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea818573-8c5c-498d-a03b-94a533cb06bc None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:52.185822 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea818573-8c5c-498d-a03b-94a533cb06bc None admin] PATH_INFO: `/v3/projects` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:52.186862 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea818573-8c5c-498d-a03b-94a533cb06bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:52.187544 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea818573-8c5c-498d-a03b-94a533cb06bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:52.189463 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea818573-8c5c-498d-a03b-94a533cb06bc None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:52.211035 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 313/654] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 27 20:13:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:52.212042 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea818573-8c5c-498d-a03b-94a533cb06bc None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:52.260891 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:52.302526 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cc711-dcd2-42e5-b7d8-ba3899b4e224 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:52.330708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea818573-8c5c-498d-a03b-94a533cb06bc None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:52.342571 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871409a-70ac-4c3b-a6ed-fe05d5b99590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:52.343560 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871409a-70ac-4c3b-a6ed-fe05d5b99590 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:52.343839 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871409a-70ac-4c3b-a6ed-fe05d5b99590 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:52.344117 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871409a-70ac-4c3b-a6ed-fe05d5b99590 None admin] PATH_INFO: `/v3/services/image` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:52.344751 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871409a-70ac-4c3b-a6ed-fe05d5b99590 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:52.346139 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871409a-70ac-4c3b-a6ed-fe05d5b99590 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:52.359127 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-1871409a-70ac-4c3b-a6ed-fe05d5b99590 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 20:13:52.359127 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:52.359127 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 20:13:52.359127 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 20:13:52.359127 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 20:13:52.359127 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 20:13:52.359127 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 20:13:52.359127 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:13:52.359127 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 20:13:52.359127 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:52.359127 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 20:13:52.359127 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:52.359127 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:52.359127 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:52.359127 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:52.359127 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:52.359127 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:52.360151 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:52.360151 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:52.360151 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:52.360151 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:52.360151 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:52.360151 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:52.360151 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 20:13:52.360151 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 20:13:52.360151 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 20:13:52.360151 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 20:13:52.360151 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:52.360151 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:52.360151 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:52.360151 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:52.360151 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:52.360151 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:52.361183 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:52.361183 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:52.361183 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:52.361183 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:52.361183 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:52.361183 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:52.361183 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:52.361183 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:52.361183 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:52.361183 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:52.361183 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 20:13:52.361183 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:13:52.361183 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 20:13:52.361183 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:52.361183 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 342/655] 10.222.0.83 () {56 vars in 1105 bytes} [Wed Jul 27 20:13:52 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:13:52.361968 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0387d-59e0-48a5-b28b-f6f2c376dcf9 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:52.361968 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0387d-59e0-48a5-b28b-f6f2c376dcf9 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:52.361968 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0387d-59e0-48a5-b28b-f6f2c376dcf9 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:52.363364 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 343/656] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:52.368231 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0387d-59e0-48a5-b28b-f6f2c376dcf9 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:52.374185 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89d106-1fc6-43a4-a365-b4c00e4f9477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:52.374803 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89d106-1fc6-43a4-a365-b4c00e4f9477 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:52.375371 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89d106-1fc6-43a4-a365-b4c00e4f9477 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:52.375645 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89d106-1fc6-43a4-a365-b4c00e4f9477 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:52.376426 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89d106-1fc6-43a4-a365-b4c00e4f9477 None admin] RBAC: Adding query filter params (role.id=df8ec36d044b469d8854eba8394eb107, scope.project.id=75313278ff3747909a57b6f37496d31e, user.id=f68b37524d7245e4b606ad8dd15442ef) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:52.376736 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89d106-1fc6-43a4-a365-b4c00e4f9477 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:52.378152 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89d106-1fc6-43a4-a365-b4c00e4f9477 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:52.391285 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 314/657] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:13:52 2022] GET /identity/v3/role_assignments?user.id=f68b37524d7245e4b606ad8dd15442ef&scope.project.id=75313278ff3747909a57b6f37496d31e&role.id=df8ec36d044b469d8854eba8394eb107 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:52.394315 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec711e-ce29-416b-ac76-678c92db8c8c None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:52.394933 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec711e-ce29-416b-ac76-678c92db8c8c None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:52.395725 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec711e-ce29-416b-ac76-678c92db8c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:52.422471 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-85ec711e-ce29-416b-ac76-678c92db8c8c None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:52.423719 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-85ec711e-ce29-416b-ac76-678c92db8c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:52.424319 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:52.509746 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0387d-59e0-48a5-b28b-f6f2c376dcf9 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:52.516110 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 315/658] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:52.535488 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec711e-ce29-416b-ac76-678c92db8c8c None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:52.565273 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25d026-5d9e-4d44-bbd3-9446a8085d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:52.566512 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25d026-5d9e-4d44-bbd3-9446a8085d03 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:52.567004 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25d026-5d9e-4d44-bbd3-9446a8085d03 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:52.567519 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25d026-5d9e-4d44-bbd3-9446a8085d03 None admin] PATH_INFO: `/v3/services` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:52.569063 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25d026-5d9e-4d44-bbd3-9446a8085d03 None admin] RBAC: Adding query filter params (name=image) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:52.569676 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25d026-5d9e-4d44-bbd3-9446a8085d03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:52.571279 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25d026-5d9e-4d44-bbd3-9446a8085d03 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:52.576535 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 344/659] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:52.583238 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25d026-5d9e-4d44-bbd3-9446a8085d03 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:52.585843 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:52.671445 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec711e-ce29-416b-ac76-678c92db8c8c None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:52.699553 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25d026-5d9e-4d44-bbd3-9446a8085d03 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:52.710333 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:52.710644 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd370432-324c-4041-b655-c1baf32b8210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:52.711530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd370432-324c-4041-b655-c1baf32b8210 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:52.713075 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd370432-324c-4041-b655-c1baf32b8210 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:52.713627 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd370432-324c-4041-b655-c1baf32b8210 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:52.714404 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd370432-324c-4041-b655-c1baf32b8210 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:52.716517 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd370432-324c-4041-b655-c1baf32b8210 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:52.733304 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-fd370432-324c-4041-b655-c1baf32b8210 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 20:13:52.733304 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:52.733304 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 20:13:52.733304 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 20:13:52.733304 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 20:13:52.733304 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 20:13:52.733304 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 20:13:52.733304 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:13:52.733304 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 20:13:52.733304 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:52.733304 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 20:13:52.733304 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:52.733304 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:52.733304 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:52.733304 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:52.733304 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:52.734482 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:52.734482 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:52.734482 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:52.734482 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:52.734482 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:52.734482 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:52.734482 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:52.734482 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 20:13:52.734482 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 20:13:52.734482 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 20:13:52.734482 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 20:13:52.734482 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:52.734482 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:52.734482 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:52.734482 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:52.734482 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:52.735567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:52.735567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:52.735567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:52.735567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:52.735567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:52.735567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:52.735567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:52.735567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:52.735567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:52.735567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:52.735567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:52.735567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 20:13:52.735567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:13:52.735567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 20:13:52.735567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:52.738764 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 316/660] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Jul 27 20:13:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:52.745129 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd370432-324c-4041-b655-c1baf32b8210 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:52.747149 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077ae4d-8f3f-438c-b607-1ef470b551a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:52.747789 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077ae4d-8f3f-438c-b607-1ef470b551a4 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:52.748068 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077ae4d-8f3f-438c-b607-1ef470b551a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:52.748337 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077ae4d-8f3f-438c-b607-1ef470b551a4 None admin] PATH_INFO: `/v3/services` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:52.749029 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077ae4d-8f3f-438c-b607-1ef470b551a4 None admin] RBAC: Adding query filter params (type=image) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:52.749332 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077ae4d-8f3f-438c-b607-1ef470b551a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:52.750970 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077ae4d-8f3f-438c-b607-1ef470b551a4 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:52.763222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 345/661] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:52.878282 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd370432-324c-4041-b655-c1baf32b8210 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:52.881377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:52.920686 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17bfa4-a0fc-44c1-8dc8-24fd116f2ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:52.921616 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17bfa4-a0fc-44c1-8dc8-24fd116f2ca8 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:52.922047 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17bfa4-a0fc-44c1-8dc8-24fd116f2ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:52.922465 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17bfa4-a0fc-44c1-8dc8-24fd116f2ca8 None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:52.923395 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17bfa4-a0fc-44c1-8dc8-24fd116f2ca8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:52.923864 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17bfa4-a0fc-44c1-8dc8-24fd116f2ca8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:52.925709 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17bfa4-a0fc-44c1-8dc8-24fd116f2ca8 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:52.932584 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846a332-9bdb-4df5-80e8-c7a0b4ba2054 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:52.932824 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 317/662] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Jul 27 20:13:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:52.937503 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846a332-9bdb-4df5-80e8-c7a0b4ba2054 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:52.937503 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846a332-9bdb-4df5-80e8-c7a0b4ba2054 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:52.937862 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 346/663] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 20:13:52.940053 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17bfa4-a0fc-44c1-8dc8-24fd116f2ca8 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:52.942033 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaacbcf-33b4-448c-94b3-4b95244ecacb None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:52.942621 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaacbcf-33b4-448c-94b3-4b95244ecacb None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:52.942939 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaacbcf-33b4-448c-94b3-4b95244ecacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:52.973573 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-8aaacbcf-33b4-448c-94b3-4b95244ecacb None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:52.975661 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-8aaacbcf-33b4-448c-94b3-4b95244ecacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:53.069978 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17bfa4-a0fc-44c1-8dc8-24fd116f2ca8 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:53.083110 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 347/664] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:53.095587 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaacbcf-33b4-448c-94b3-4b95244ecacb None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:53.122756 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4055cc-aa39-4b67-bf31-44de6b744604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:53.123425 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4055cc-aa39-4b67-bf31-44de6b744604 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:53.123718 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4055cc-aa39-4b67-bf31-44de6b744604 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:53.123984 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4055cc-aa39-4b67-bf31-44de6b744604 None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:53.125094 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4055cc-aa39-4b67-bf31-44de6b744604 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:53.125499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4055cc-aa39-4b67-bf31-44de6b744604 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:53.127182 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4055cc-aa39-4b67-bf31-44de6b744604 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:53.136203 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 318/665] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Jul 27 20:13:52 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:53.225864 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaacbcf-33b4-448c-94b3-4b95244ecacb None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:53.228066 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:53.264591 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05d1d8-8c8d-4884-9ade-6029ea19f423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:53.265628 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05d1d8-8c8d-4884-9ade-6029ea19f423 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:53.266105 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05d1d8-8c8d-4884-9ade-6029ea19f423 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:53.266601 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05d1d8-8c8d-4884-9ade-6029ea19f423 None admin] PATH_INFO: `/v3/services/network` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:53.267478 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05d1d8-8c8d-4884-9ade-6029ea19f423 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:53.269200 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05d1d8-8c8d-4884-9ade-6029ea19f423 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:53.279906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-5a05d1d8-8c8d-4884-9ade-6029ea19f423 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 20:13:53.279906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:53.279906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 20:13:53.279906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 20:13:53.279906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 20:13:53.279906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 20:13:53.279906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 20:13:53.279906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:13:53.279906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 20:13:53.279906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:53.279906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 20:13:53.279906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:53.279906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:53.279906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:53.279906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:53.279906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:53.279906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:53.280986 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:53.280986 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:53.280986 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:53.280986 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:53.280986 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:53.280986 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:53.280986 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 20:13:53.280986 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 20:13:53.280986 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 20:13:53.280986 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 20:13:53.280986 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:53.280986 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:53.280986 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:53.280986 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:53.280986 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:53.280986 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:53.281832 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:53.281832 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:53.281832 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:53.281832 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:53.281832 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:53.281832 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:53.281832 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:53.281832 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:53.281832 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:53.281832 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:53.281832 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 20:13:53.281832 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:13:53.281832 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 20:13:53.281832 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:53.288349 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 348/666] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:13:53 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:13:53.291538 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4055cc-aa39-4b67-bf31-44de6b744604 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:53.326173 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:53.402772 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4055cc-aa39-4b67-bf31-44de6b744604 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:53.438330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd226ca5-98a5-44a5-abdf-978346fefba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:53.439222 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd226ca5-98a5-44a5-abdf-978346fefba9 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:53.439674 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd226ca5-98a5-44a5-abdf-978346fefba9 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:53.440147 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd226ca5-98a5-44a5-abdf-978346fefba9 None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:53.441108 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd226ca5-98a5-44a5-abdf-978346fefba9 None admin] RBAC: Adding query filter params (name=network) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:53.441556 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd226ca5-98a5-44a5-abdf-978346fefba9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:53.443061 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd226ca5-98a5-44a5-abdf-978346fefba9 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:53.448776 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 319/667] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Jul 27 20:13:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:53.456713 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05d1d8-8c8d-4884-9ade-6029ea19f423 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:53.561428 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05d1d8-8c8d-4884-9ade-6029ea19f423 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:53.598477 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9630a9c-a6a8-4706-97b2-ce97de3aa7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:53.599015 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9630a9c-a6a8-4706-97b2-ce97de3aa7cf None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:53.599325 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9630a9c-a6a8-4706-97b2-ce97de3aa7cf None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:53.599632 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9630a9c-a6a8-4706-97b2-ce97de3aa7cf None admin] PATH_INFO: `/v3/services` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:53.600311 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9630a9c-a6a8-4706-97b2-ce97de3aa7cf None admin] RBAC: Adding query filter params (type=network) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:53.600671 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9630a9c-a6a8-4706-97b2-ce97de3aa7cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:53.602102 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9630a9c-a6a8-4706-97b2-ce97de3aa7cf None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:53.607010 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 349/668] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Jul 27 20:13:53 2022] GET /identity/v3/services?type=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:54.691037 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46183ac0-7705-4b56-8d5e-f8fede3e9351 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:54.691554 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46183ac0-7705-4b56-8d5e-f8fede3e9351 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:54.691832 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46183ac0-7705-4b56-8d5e-f8fede3e9351 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:54.693575 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 320/669] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:54.698781 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8f0ea-6ae1-4ea6-af53-2d611097ebc5 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:54.699234 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8f0ea-6ae1-4ea6-af53-2d611097ebc5 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:54.699553 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8f0ea-6ae1-4ea6-af53-2d611097ebc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:54.718720 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-65e8f0ea-6ae1-4ea6-af53-2d611097ebc5 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:54.719960 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-65e8f0ea-6ae1-4ea6-af53-2d611097ebc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:54.745046 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:54.794690 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 350/670] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:54.817763 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46183ac0-7705-4b56-8d5e-f8fede3e9351 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:54.944164 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:54.953094 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46183ac0-7705-4b56-8d5e-f8fede3e9351 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:54.989165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db1bb7-1778-4555-8af0-fe8492e0ad64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:54.990379 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db1bb7-1778-4555-8af0-fe8492e0ad64 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:54.990930 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db1bb7-1778-4555-8af0-fe8492e0ad64 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:54.991435 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db1bb7-1778-4555-8af0-fe8492e0ad64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:55.002510 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db1bb7-1778-4555-8af0-fe8492e0ad64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:55.008282 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-51db1bb7-1778-4555-8af0-fe8492e0ad64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:13:55.008282 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:55.008282 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:55.008282 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:55.008282 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:55.008282 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:55.008282 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:55.008282 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:55.008282 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:55.008282 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:55.008282 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:55.008282 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:55.008282 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:55.008282 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:55.008282 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:55.008282 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:55.009200 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:55.009200 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:55.009200 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:55.009200 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:55.009200 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:55.009200 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:55.009200 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:55.009200 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:55.009200 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:55.009200 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:55.009200 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:55.009200 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:55.009200 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:55.009200 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:55.009200 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:55.009200 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:55.010033 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:55.010033 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:55.010033 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:55.010033 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:55.010033 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:55.010033 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:55.010033 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:55.010033 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:55.010033 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:55.010033 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:55.010033 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:13:55.010033 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:55.012673 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 321/671] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 27 20:13:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:55.019134 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8f0ea-6ae1-4ea6-af53-2d611097ebc5 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:55.081873 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f467b0e-8e16-46ea-ab8e-e6736cbd0f17 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:55.082160 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f467b0e-8e16-46ea-ab8e-e6736cbd0f17 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:55.082440 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f467b0e-8e16-46ea-ab8e-e6736cbd0f17 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:55.084626 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 322/672] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:55.089367 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77a28f-b641-4f00-834c-d4849d27da19 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:55.089651 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77a28f-b641-4f00-834c-d4849d27da19 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:55.089929 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77a28f-b641-4f00-834c-d4849d27da19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:55.108559 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-bc77a28f-b641-4f00-834c-d4849d27da19 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:55.109940 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-bc77a28f-b641-4f00-834c-d4849d27da19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:55.124192 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8f0ea-6ae1-4ea6-af53-2d611097ebc5 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:55.163479 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf2ab0-acc4-41cd-bca2-8f85e22568df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:55.164105 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf2ab0-acc4-41cd-bca2-8f85e22568df None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:55.164384 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf2ab0-acc4-41cd-bca2-8f85e22568df None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:55.164656 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf2ab0-acc4-41cd-bca2-8f85e22568df None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:55.165368 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf2ab0-acc4-41cd-bca2-8f85e22568df None admin] RBAC: Adding query filter params (name=admin) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:55.165671 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf2ab0-acc4-41cd-bca2-8f85e22568df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:55.167033 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf2ab0-acc4-41cd-bca2-8f85e22568df None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:55.179118 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 351/673] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:55.181746 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf2ab0-acc4-41cd-bca2-8f85e22568df None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:55.207165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 323/674] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 20:13:55.214665 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:55.230606 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77a28f-b641-4f00-834c-d4849d27da19 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:55.309782 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf2ab0-acc4-41cd-bca2-8f85e22568df None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:55.330219 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:55.351627 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64db3d5-d1bc-4a79-9e2a-7b9360e4c0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:55.352235 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77a28f-b641-4f00-834c-d4849d27da19 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:55.352819 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64db3d5-d1bc-4a79-9e2a-7b9360e4c0d5 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:55.353298 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64db3d5-d1bc-4a79-9e2a-7b9360e4c0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:55.353862 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64db3d5-d1bc-4a79-9e2a-7b9360e4c0d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:55.366139 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64db3d5-d1bc-4a79-9e2a-7b9360e4c0d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:55.368005 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64db3d5-d1bc-4a79-9e2a-7b9360e4c0d5 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:55.385341 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-f64db3d5-d1bc-4a79-9e2a-7b9360e4c0d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:55.385341 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:55.385341 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:55.385341 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:55.385341 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:55.385341 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:55.385341 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:55.385341 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:55.385341 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:55.385341 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:55.385341 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:55.385341 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:55.385341 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:55.385341 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:55.385341 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:55.386310 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:55.386310 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:55.386310 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:55.386310 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:55.386310 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:55.386310 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:55.386310 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:55.386310 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:55.386310 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:55.386310 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:55.386310 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:55.386310 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:55.386310 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:55.386310 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:55.386310 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:55.386310 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:55.386310 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:55.387254 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:55.387254 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:55.387254 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:55.387254 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:55.389733 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 352/675] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:13:55.395716 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64db3d5-d1bc-4a79-9e2a-7b9360e4c0d5 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:55.402324 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6130f77-acaa-4068-b777-80729535ac67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:55.402972 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6130f77-acaa-4068-b777-80729535ac67 None admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:55.403290 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6130f77-acaa-4068-b777-80729535ac67 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:55.403568 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6130f77-acaa-4068-b777-80729535ac67 None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:55.404300 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6130f77-acaa-4068-b777-80729535ac67 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:55.405731 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6130f77-acaa-4068-b777-80729535ac67 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:55.436355 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 324/676] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Jul 27 20:13:55 2022] POST /identity/v3/services => generated 242 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 20:13:55.495989 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:55.525529 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64db3d5-d1bc-4a79-9e2a-7b9360e4c0d5 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:55.549080 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ba81c-00c5-4ece-a201-01a12b889891 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:55.549415 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ba81c-00c5-4ece-a201-01a12b889891 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:55.549648 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ba81c-00c5-4ece-a201-01a12b889891 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:55.550992 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 325/677] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 20:13:55.556499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f57980-61f2-4b61-a664-ee871fa374ce None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:55.556774 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f57980-61f2-4b61-a664-ee871fa374ce None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:55.557055 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f57980-61f2-4b61-a664-ee871fa374ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:55.573318 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74daeed-bf68-4b1e-a98c-6b0e5095b10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:55.573947 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74daeed-bf68-4b1e-a98c-6b0e5095b10a None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:55.574227 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74daeed-bf68-4b1e-a98c-6b0e5095b10a None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:55.574504 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74daeed-bf68-4b1e-a98c-6b0e5095b10a None admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:55.575230 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74daeed-bf68-4b1e-a98c-6b0e5095b10a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:55.575643 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74daeed-bf68-4b1e-a98c-6b0e5095b10a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:55.576351 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-38f57980-61f2-4b61-a664-ee871fa374ce None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:55.577141 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74daeed-bf68-4b1e-a98c-6b0e5095b10a None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:55.577571 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-38f57980-61f2-4b61-a664-ee871fa374ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:55.594766 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 353/678] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:55.601398 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74daeed-bf68-4b1e-a98c-6b0e5095b10a None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:55.673714 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 326/679] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:55 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 20:13:55.704439 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f57980-61f2-4b61-a664-ee871fa374ce None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:55.729646 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74daeed-bf68-4b1e-a98c-6b0e5095b10a None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:55.765861 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:55.775411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4184d-e770-476f-a29c-15a41e669948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:55.776315 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4184d-e770-476f-a29c-15a41e669948 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:55.776746 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4184d-e770-476f-a29c-15a41e669948 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:55.777186 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4184d-e770-476f-a29c-15a41e669948 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:55.785315 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4184d-e770-476f-a29c-15a41e669948 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:55.787004 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4184d-e770-476f-a29c-15a41e669948 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:55.799558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-99f4184d-e770-476f-a29c-15a41e669948 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 20:13:55.799558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:55.799558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:55.799558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:55.799558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:55.799558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:55.799558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:55.799558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:55.799558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:55.799558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:55.799558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:55.799558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:55.799558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 20:13:55.799558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 20:13:55.799558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 20:13:55.799558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 20:13:55.800558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:55.800558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:55.800558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 20:13:55.800558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:55.800558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 20:13:55.800558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:13:55.800558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:55.800558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:55.800558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:55.800558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:55.800558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:55.800558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:55.800558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:55.800558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:55.800558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:55.800558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:55.800558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:55.800558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:55.801581 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:55.801581 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:55.801581 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 20:13:55.801581 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 20:13:55.801581 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 20:13:55.801581 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 20:13:55.801581 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 20:13:55.801581 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 20:13:55.801581 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 20:13:55.801581 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:55.804222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 354/680] 10.222.0.83 () {56 vars in 1093 bytes} [Wed Jul 27 20:13:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:55.810628 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4184d-e770-476f-a29c-15a41e669948 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:55.813156 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:55.842213 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f57980-61f2-4b61-a664-ee871fa374ce None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:55.878235 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69699aad-ade2-4d30-8765-977bf3c324b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:55.878868 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69699aad-ade2-4d30-8765-977bf3c324b9 None admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:55.879188 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69699aad-ade2-4d30-8765-977bf3c324b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:55.879467 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69699aad-ade2-4d30-8765-977bf3c324b9 None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:55.880945 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69699aad-ade2-4d30-8765-977bf3c324b9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:55.882048 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69699aad-ade2-4d30-8765-977bf3c324b9 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:55.903108 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 327/681] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Jul 27 20:13:55 2022] POST /identity/v3/services => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 20:13:55.907629 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3f9b0-a3f8-437b-b9d0-6ef2ca946572 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:55.907963 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3f9b0-a3f8-437b-b9d0-6ef2ca946572 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:55.908270 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3f9b0-a3f8-437b-b9d0-6ef2ca946572 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:55.909963 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 328/682] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 20:13:55.916530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd3006-61b3-47d5-8466-5a79836d4f52 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:55.916832 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd3006-61b3-47d5-8466-5a79836d4f52 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:55.917078 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd3006-61b3-47d5-8466-5a79836d4f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:55.936704 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-c0dd3006-61b3-47d5-8466-5a79836d4f52 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:55.937925 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-c0dd3006-61b3-47d5-8466-5a79836d4f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:55.961209 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4184d-e770-476f-a29c-15a41e669948 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:56.007725 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad766a-e7d0-4ce3-bc43-53bc2128e22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:56.008358 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad766a-e7d0-4ce3-bc43-53bc2128e22b None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:56.008638 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad766a-e7d0-4ce3-bc43-53bc2128e22b None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:56.008910 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad766a-e7d0-4ce3-bc43-53bc2128e22b None admin] PATH_INFO: `/v3/users` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:56.010181 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad766a-e7d0-4ce3-bc43-53bc2128e22b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:56.010555 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad766a-e7d0-4ce3-bc43-53bc2128e22b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:56.012105 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad766a-e7d0-4ce3-bc43-53bc2128e22b None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:56.031357 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 329/683] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:55 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 20:13:56.035809 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 355/684] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Jul 27 20:13:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:56.041092 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd3006-61b3-47d5-8466-5a79836d4f52 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:56.051737 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad766a-e7d0-4ce3-bc43-53bc2128e22b None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:56.108277 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:56.122461 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:56.178264 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd3006-61b3-47d5-8466-5a79836d4f52 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:56.191293 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad766a-e7d0-4ce3-bc43-53bc2128e22b None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:56.224102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c8f00-f20a-41bf-ae22-7227b673d119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:56.225356 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c8f00-f20a-41bf-ae22-7227b673d119 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:56.225755 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c8f00-f20a-41bf-ae22-7227b673d119 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:56.226126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c8f00-f20a-41bf-ae22-7227b673d119 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:56.231090 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09d40b-74fc-4fa9-843f-a20dd1014afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:56.231925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09d40b-74fc-4fa9-843f-a20dd1014afc None admin] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:56.232397 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09d40b-74fc-4fa9-843f-a20dd1014afc None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:56.232824 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09d40b-74fc-4fa9-843f-a20dd1014afc None admin] PATH_INFO: `/v3/services` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:56.233697 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09d40b-74fc-4fa9-843f-a20dd1014afc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:56.236070 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09d40b-74fc-4fa9-843f-a20dd1014afc None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:56.237981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c8f00-f20a-41bf-ae22-7227b673d119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:56.239545 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c8f00-f20a-41bf-ae22-7227b673d119 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:56.258673 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-e38c8f00-f20a-41bf-ae22-7227b673d119 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:56.258673 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:56.258673 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:56.258673 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:56.258673 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:56.258673 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:56.258673 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:56.258673 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:56.258673 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:56.258673 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:56.258673 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:56.258673 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:56.258673 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:13:56.258673 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:13:56.258673 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:13:56.259786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:13:56.259786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:56.259786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:56.259786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:56.259786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:56.259786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:56.259786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:56.259786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:56.259786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:56.259786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:56.259786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:56.259786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:56.259786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:56.259786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:56.259786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:56.259786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:56.259786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:56.261008 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:13:56.261008 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:13:56.261008 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:13:56.261008 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:56.261008 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 330/685] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:56.265715 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c8f00-f20a-41bf-ae22-7227b673d119 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:56.279764 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 356/686] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Jul 27 20:13:56 2022] POST /identity/v3/services => generated 240 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 20:13:56.388583 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c8f00-f20a-41bf-ae22-7227b673d119 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:56.408749 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:56.440081 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cf671-25c9-47fe-bdca-a48c958f901c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:56.440720 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cf671-25c9-47fe-bdca-a48c958f901c None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:56.441003 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cf671-25c9-47fe-bdca-a48c958f901c None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:56.441272 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cf671-25c9-47fe-bdca-a48c958f901c None admin] PATH_INFO: `/v3/domains` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:56.441969 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cf671-25c9-47fe-bdca-a48c958f901c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:56.442337 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cf671-25c9-47fe-bdca-a48c958f901c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:56.444486 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cf671-25c9-47fe-bdca-a48c958f901c None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:56.458247 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 331/687] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:56.463663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09d40b-74fc-4fa9-843f-a20dd1014afc None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:56.584926 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09d40b-74fc-4fa9-843f-a20dd1014afc None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:56.587328 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:56.622827 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd944c3-bf5e-4b2b-8fe8-b21ba648b735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:56.623572 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd944c3-bf5e-4b2b-8fe8-b21ba648b735 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:56.623854 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd944c3-bf5e-4b2b-8fe8-b21ba648b735 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:56.624124 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd944c3-bf5e-4b2b-8fe8-b21ba648b735 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:56.631362 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd944c3-bf5e-4b2b-8fe8-b21ba648b735 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:56.632802 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd944c3-bf5e-4b2b-8fe8-b21ba648b735 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:56.644236 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-bbd944c3-bf5e-4b2b-8fe8-b21ba648b735 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:56.644236 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:56.644236 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:56.644236 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:56.644236 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:56.644236 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:56.644236 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:56.644236 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:56.644236 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:56.644236 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:56.644236 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:56.644236 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:56.644236 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 20:13:56.644236 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 20:13:56.644236 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 20:13:56.645131 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 20:13:56.645131 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:56.645131 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:56.645131 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:56.645131 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:56.645131 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:56.645131 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:56.645131 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:56.645131 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:56.645131 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:56.645131 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:56.645131 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:56.645131 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:56.645131 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:56.645131 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:56.645131 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:56.645131 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:56.646452 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 20:13:56.646452 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 20:13:56.646452 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 20:13:56.646452 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 20:13:56.646452 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 20:13:56.646452 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 20:13:56.646452 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:13:56.646452 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:56.646452 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 357/688] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:13:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:56.651369 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cf671-25c9-47fe-bdca-a48c958f901c None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:56.757619 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cf671-25c9-47fe-bdca-a48c958f901c None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:56.793357 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546200a-5d07-4ff9-8e49-dd02e5f1857f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:56.794348 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546200a-5d07-4ff9-8e49-dd02e5f1857f None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:56.794829 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546200a-5d07-4ff9-8e49-dd02e5f1857f None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:56.795346 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546200a-5d07-4ff9-8e49-dd02e5f1857f None admin] PATH_INFO: `/v3/projects` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:56.796359 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546200a-5d07-4ff9-8e49-dd02e5f1857f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:56.796962 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546200a-5d07-4ff9-8e49-dd02e5f1857f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:56.799840 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546200a-5d07-4ff9-8e49-dd02e5f1857f None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:56.816808 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 332/689] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 27 20:13:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:56.827204 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd944c3-bf5e-4b2b-8fe8-b21ba648b735 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:56.930287 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd944c3-bf5e-4b2b-8fe8-b21ba648b735 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:56.964864 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77efab7-0f15-40c9-9bd0-dd79832cb634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:56.965863 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77efab7-0f15-40c9-9bd0-dd79832cb634 None admin] REQUEST_METHOD: `PUT` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:56.966348 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77efab7-0f15-40c9-9bd0-dd79832cb634 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:56.966852 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77efab7-0f15-40c9-9bd0-dd79832cb634 None admin] PATH_INFO: `/v3/projects/75313278ff3747909a57b6f37496d31e/users/f68b37524d7245e4b606ad8dd15442ef/roles/df8ec36d044b469d8854eba8394eb107` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:56.969053 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77efab7-0f15-40c9-9bd0-dd79832cb634 None admin] RBAC: Authorizing `identity:create_grant(project_id=75313278ff3747909a57b6f37496d31e, user_id=f68b37524d7245e4b606ad8dd15442ef, role_id=df8ec36d044b469d8854eba8394eb107)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:56.970723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77efab7-0f15-40c9-9bd0-dd79832cb634 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:56.988033 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 358/690] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 27 20:13:56 2022] PUT /identity/v3/projects/75313278ff3747909a57b6f37496d31e/users/f68b37524d7245e4b606ad8dd15442ef/roles/df8ec36d044b469d8854eba8394eb107 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:13:57.800121 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e19a42-068d-4e6a-b3cc-ca11b1058415 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:57.800637 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e19a42-068d-4e6a-b3cc-ca11b1058415 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:57.800715 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e19a42-068d-4e6a-b3cc-ca11b1058415 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:57.802773 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 333/691] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:57.807963 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d54e3a-640a-40f2-87ef-8f39840ffbab None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:57.808250 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d54e3a-640a-40f2-87ef-8f39840ffbab None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:57.808523 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d54e3a-640a-40f2-87ef-8f39840ffbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:57.827284 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-c1d54e3a-640a-40f2-87ef-8f39840ffbab None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:57.828461 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-c1d54e3a-640a-40f2-87ef-8f39840ffbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:57.845859 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:57.895827 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 359/692] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:57 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:13:57.919785 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e19a42-068d-4e6a-b3cc-ca11b1058415 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:57.959668 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:58.027433 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e19a42-068d-4e6a-b3cc-ca11b1058415 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:58.063036 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453836b-cb94-460c-aee9-33889504e7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:58.063680 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453836b-cb94-460c-aee9-33889504e7dc None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:58.063961 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453836b-cb94-460c-aee9-33889504e7dc None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:58.064228 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453836b-cb94-460c-aee9-33889504e7dc None admin] PATH_INFO: `/v3/services/image` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:58.064901 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453836b-cb94-460c-aee9-33889504e7dc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:58.066407 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453836b-cb94-460c-aee9-33889504e7dc None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:58.075373 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-1453836b-cb94-460c-aee9-33889504e7dc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 20:13:58.075373 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:58.075373 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 20:13:58.075373 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 20:13:58.075373 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 20:13:58.075373 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 20:13:58.075373 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 20:13:58.075373 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:13:58.075373 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 20:13:58.075373 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:58.075373 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 20:13:58.075373 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:58.075373 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:58.075373 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:58.075373 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:58.075373 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:58.075373 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:58.076456 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:58.076456 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:58.076456 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:58.076456 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:58.076456 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:58.076456 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:58.076456 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 20:13:58.076456 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 20:13:58.076456 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 20:13:58.076456 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 20:13:58.076456 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:58.076456 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:58.076456 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:58.076456 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:58.076456 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:58.076456 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:58.077320 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:58.077320 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:58.077320 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:58.077320 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:58.077320 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:58.077320 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:58.077320 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:58.077320 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:58.077320 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:58.077320 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:58.077320 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 20:13:58.077320 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:13:58.077320 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 20:13:58.077320 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:58.077320 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 334/693] 10.222.0.83 () {56 vars in 1105 bytes} [Wed Jul 27 20:13:57 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:58.082394 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d54e3a-640a-40f2-87ef-8f39840ffbab None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:58.189761 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d54e3a-640a-40f2-87ef-8f39840ffbab None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:58.229643 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86faba7a-3b94-4e76-81fa-21c7bce79b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:58.230262 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faba7a-3b94-4e76-81fa-21c7bce79b35 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:58.230537 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faba7a-3b94-4e76-81fa-21c7bce79b35 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:58.230804 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faba7a-3b94-4e76-81fa-21c7bce79b35 None admin] PATH_INFO: `/v3/services` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:58.231515 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86faba7a-3b94-4e76-81fa-21c7bce79b35 None admin] RBAC: Adding query filter params (name=image) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:58.231813 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86faba7a-3b94-4e76-81fa-21c7bce79b35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:58.233172 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86faba7a-3b94-4e76-81fa-21c7bce79b35 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:58.238206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 360/694] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:58.244171 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453836b-cb94-460c-aee9-33889504e7dc None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:58.294156 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e913be4-3c14-4a02-823e-189d278ccb85 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:58.294466 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e913be4-3c14-4a02-823e-189d278ccb85 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:58.294712 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e913be4-3c14-4a02-823e-189d278ccb85 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:58.296339 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 361/695] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:58.301582 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e17fcb-bf73-4434-944e-e3d46f88848d None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:58.301867 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e17fcb-bf73-4434-944e-e3d46f88848d None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:58.302717 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e17fcb-bf73-4434-944e-e3d46f88848d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:58.327575 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-76e17fcb-bf73-4434-944e-e3d46f88848d None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:58.329059 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-76e17fcb-bf73-4434-944e-e3d46f88848d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:58.352655 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:58.364107 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:58.368858 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453836b-cb94-460c-aee9-33889504e7dc None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:58.413578 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222bda0-f2b4-42e4-a6c4-8c8f63a16dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:58.414530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222bda0-f2b4-42e4-a6c4-8c8f63a16dd1 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:58.414944 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222bda0-f2b4-42e4-a6c4-8c8f63a16dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:58.415404 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222bda0-f2b4-42e4-a6c4-8c8f63a16dd1 None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:58.416100 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222bda0-f2b4-42e4-a6c4-8c8f63a16dd1 None admin] RBAC: Adding query filter params (type=image) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:58.416408 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222bda0-f2b4-42e4-a6c4-8c8f63a16dd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:58.418365 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222bda0-f2b4-42e4-a6c4-8c8f63a16dd1 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:58.431098 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 335/697] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:58.431098 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222bda0-f2b4-42e4-a6c4-8c8f63a16dd1 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:58.431352 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 362/697] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:58 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 20:13:58.455496 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e17fcb-bf73-4434-944e-e3d46f88848d None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:58.537656 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222bda0-f2b4-42e4-a6c4-8c8f63a16dd1 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:58.561145 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e17fcb-bf73-4434-944e-e3d46f88848d None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:58.574421 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca3420-5a9d-40c6-8761-0f45aa4098a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:58.575387 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca3420-5a9d-40c6-8761-0f45aa4098a7 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:58.575954 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca3420-5a9d-40c6-8761-0f45aa4098a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:58.576474 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca3420-5a9d-40c6-8761-0f45aa4098a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:58.577473 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca3420-5a9d-40c6-8761-0f45aa4098a7 None admin] RBAC: Adding query filter params (interface=public, service_id=d0e8cca24be345b5be8f038aaaa6baf2, region_id=RegionOne) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:58.577989 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca3420-5a9d-40c6-8761-0f45aa4098a7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:58.579739 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca3420-5a9d-40c6-8761-0f45aa4098a7 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:58.588894 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 336/698] 10.222.0.83 () {56 vars in 1251 bytes} [Wed Jul 27 20:13:58 2022] GET /identity/v3/endpoints?service_id=d0e8cca24be345b5be8f038aaaa6baf2&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:58.594106 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca3420-5a9d-40c6-8761-0f45aa4098a7 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:58.607538 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5d510-a4f8-4735-b65b-130da8cbce82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:58.608634 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5d510-a4f8-4735-b65b-130da8cbce82 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:58.609196 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5d510-a4f8-4735-b65b-130da8cbce82 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:58.609751 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5d510-a4f8-4735-b65b-130da8cbce82 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:58.610617 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5d510-a4f8-4735-b65b-130da8cbce82 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:58.612445 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5d510-a4f8-4735-b65b-130da8cbce82 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:58.623357 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-75f5d510-a4f8-4735-b65b-130da8cbce82 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 20:13:58.623357 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:58.623357 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 20:13:58.623357 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 20:13:58.623357 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 20:13:58.623357 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 20:13:58.623357 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 20:13:58.623357 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:13:58.623357 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 20:13:58.623357 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:58.623357 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 20:13:58.623357 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:58.623357 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:58.623357 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:58.623357 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:58.623357 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:58.624404 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:58.624404 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:58.624404 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:58.624404 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:58.624404 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:58.624404 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:58.624404 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:58.624404 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 20:13:58.624404 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 20:13:58.624404 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 20:13:58.624404 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 20:13:58.624404 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:58.624404 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:58.624404 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:58.624404 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:58.624404 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:58.625502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:58.625502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:58.625502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:58.625502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:58.625502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:58.625502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:58.625502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:58.625502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:58.625502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:58.625502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:58.625502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:58.625502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 20:13:58.625502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:13:58.625502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 20:13:58.625502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:13:58.629315 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:58.630636 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 363/699] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Jul 27 20:13:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:13:58.636609 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5d510-a4f8-4735-b65b-130da8cbce82 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:58.655814 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:58.724282 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca3420-5a9d-40c6-8761-0f45aa4098a7 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:58.761736 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538a149-2fb2-4817-8d10-078d52109e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:58.762368 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538a149-2fb2-4817-8d10-078d52109e55 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:58.762651 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538a149-2fb2-4817-8d10-078d52109e55 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:58.762979 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538a149-2fb2-4817-8d10-078d52109e55 None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:58.763623 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538a149-2fb2-4817-8d10-078d52109e55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:58.765147 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538a149-2fb2-4817-8d10-078d52109e55 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:58.771601 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 337/700] 10.222.0.83 () {56 vars in 1087 bytes} [Wed Jul 27 20:13:58 2022] GET /identity/v3/services => generated 1002 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 20:13:58.772825 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2693f1d-a05c-4508-94f4-94ca1ba21ca9 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:58.773377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2693f1d-a05c-4508-94f4-94ca1ba21ca9 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:58.773505 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2693f1d-a05c-4508-94f4-94ca1ba21ca9 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:58.774670 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 338/701] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:58.776870 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5d510-a4f8-4735-b65b-130da8cbce82 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:58.780505 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2025c-1f07-4d08-9931-b5c21922cd20 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:58.780784 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2025c-1f07-4d08-9931-b5c21922cd20 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:58.781058 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2025c-1f07-4d08-9931-b5c21922cd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:58.800314 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-94f2025c-1f07-4d08-9931-b5c21922cd20 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:58.801533 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-94f2025c-1f07-4d08-9931-b5c21922cd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:58.815305 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8215cfb-b8ff-4e9e-9cb6-dad0d176bd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:58.815944 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8215cfb-b8ff-4e9e-9cb6-dad0d176bd65 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:58.816225 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8215cfb-b8ff-4e9e-9cb6-dad0d176bd65 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:58.816498 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8215cfb-b8ff-4e9e-9cb6-dad0d176bd65 None admin] PATH_INFO: `/v3/services` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:58.817250 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8215cfb-b8ff-4e9e-9cb6-dad0d176bd65 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:58.817558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8215cfb-b8ff-4e9e-9cb6-dad0d176bd65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:58.819676 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8215cfb-b8ff-4e9e-9cb6-dad0d176bd65 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:58.830665 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 364/702] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Jul 27 20:13:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:13:58.831612 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8215cfb-b8ff-4e9e-9cb6-dad0d176bd65 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:58.894155 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 339/703] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:58 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:13:58.919232 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2025c-1f07-4d08-9931-b5c21922cd20 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:58.932172 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:58.943859 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:58.966644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8215cfb-b8ff-4e9e-9cb6-dad0d176bd65 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:59.018225 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5dae1e-395a-4c49-9995-b8d56ed45732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:59.019274 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dae1e-395a-4c49-9995-b8d56ed45732 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:59.019721 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dae1e-395a-4c49-9995-b8d56ed45732 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:59.020173 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dae1e-395a-4c49-9995-b8d56ed45732 None admin] PATH_INFO: `/v3/services` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:59.021660 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5dae1e-395a-4c49-9995-b8d56ed45732 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:59.022140 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5dae1e-395a-4c49-9995-b8d56ed45732 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:59.023749 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5dae1e-395a-4c49-9995-b8d56ed45732 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:59.029044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 365/704] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Jul 27 20:13:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:59.035313 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5dae1e-395a-4c49-9995-b8d56ed45732 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:59.057245 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2025c-1f07-4d08-9931-b5c21922cd20 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:59.103896 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c57830-6a03-4664-bc1d-40db957550f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:59.104819 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c57830-6a03-4664-bc1d-40db957550f1 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:59.105174 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c57830-6a03-4664-bc1d-40db957550f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:59.106082 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c57830-6a03-4664-bc1d-40db957550f1 None admin] PATH_INFO: `/v3/services/network` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:59.106792 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c57830-6a03-4664-bc1d-40db957550f1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:59.108747 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c57830-6a03-4664-bc1d-40db957550f1 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:59.121105 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-16c57830-6a03-4664-bc1d-40db957550f1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 20:13:59.121105 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:59.121105 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 20:13:59.121105 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 20:13:59.121105 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 20:13:59.121105 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 20:13:59.121105 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 20:13:59.121105 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:13:59.121105 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 20:13:59.121105 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:59.121105 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 20:13:59.121105 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:59.121105 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:59.121105 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:59.121105 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:59.121105 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:59.121105 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:59.122134 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:59.122134 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:59.122134 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:59.122134 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:59.122134 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:59.122134 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:59.122134 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 20:13:59.122134 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 20:13:59.122134 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 20:13:59.122134 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 20:13:59.122134 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:59.122134 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:59.122134 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:59.122134 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:59.122134 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:59.122134 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:59.123053 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:59.123053 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:59.123053 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:59.123053 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:59.123053 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:59.123053 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:59.123053 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:59.123053 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:59.123053 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:59.123053 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:59.123053 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 20:13:59.123053 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:13:59.123053 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 20:13:59.123053 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:59.124025 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 340/705] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:13:58 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:13:59.129554 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c57830-6a03-4664-bc1d-40db957550f1 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:59.150627 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5dae1e-395a-4c49-9995-b8d56ed45732 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:59.197505 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e24511-d43a-4c8f-b8f4-94e7f14f6ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:59.198452 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e24511-d43a-4c8f-b8f4-94e7f14f6ed3 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:59.198740 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e24511-d43a-4c8f-b8f4-94e7f14f6ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:59.199013 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e24511-d43a-4c8f-b8f4-94e7f14f6ed3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:59.200079 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e24511-d43a-4c8f-b8f4-94e7f14f6ed3 None admin] RBAC: Adding query filter params (interface=public, service_id=73bd7c3b6ddb42d5ae16e35fc743e593, region_id=RegionOne) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:59.200393 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e24511-d43a-4c8f-b8f4-94e7f14f6ed3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:59.201944 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e24511-d43a-4c8f-b8f4-94e7f14f6ed3 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:59.212257 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 366/706] 10.222.0.83 () {56 vars in 1251 bytes} [Wed Jul 27 20:13:59 2022] GET /identity/v3/endpoints?service_id=73bd7c3b6ddb42d5ae16e35fc743e593&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:59.217857 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e24511-d43a-4c8f-b8f4-94e7f14f6ed3 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:59.222381 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:59.239979 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:59.267338 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c57830-6a03-4664-bc1d-40db957550f1 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:59.312598 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcb5a3-ffd4-4832-8bbd-b42810b43f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:59.314617 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcb5a3-ffd4-4832-8bbd-b42810b43f4c None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:59.314816 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcb5a3-ffd4-4832-8bbd-b42810b43f4c None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:59.315106 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcb5a3-ffd4-4832-8bbd-b42810b43f4c None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:59.315790 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fcb5a3-ffd4-4832-8bbd-b42810b43f4c None admin] RBAC: Adding query filter params (name=network) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:59.316094 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fcb5a3-ffd4-4832-8bbd-b42810b43f4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:59.317477 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fcb5a3-ffd4-4832-8bbd-b42810b43f4c None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:59.328813 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 341/707] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Jul 27 20:13:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:59.328813 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d715828-dc17-4582-81f3-8fc493d4eac0 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:59.328813 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d715828-dc17-4582-81f3-8fc493d4eac0 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:59.328813 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d715828-dc17-4582-81f3-8fc493d4eac0 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:59.328813 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 342/708] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:13:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:13:59.332085 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d715828-dc17-4582-81f3-8fc493d4eac0 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:59.357102 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e24511-d43a-4c8f-b8f4-94e7f14f6ed3 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:59.396668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6072dc-f6de-41f9-86c7-f38333a1bee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:59.397293 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6072dc-f6de-41f9-86c7-f38333a1bee9 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:59.397612 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6072dc-f6de-41f9-86c7-f38333a1bee9 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:59.397846 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6072dc-f6de-41f9-86c7-f38333a1bee9 None admin] PATH_INFO: `/v3/services` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:59.398504 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6072dc-f6de-41f9-86c7-f38333a1bee9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:59.399925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6072dc-f6de-41f9-86c7-f38333a1bee9 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:59.415096 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 367/709] 10.222.0.83 () {56 vars in 1087 bytes} [Wed Jul 27 20:13:59 2022] GET /identity/v3/services => generated 1002 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 20:13:59.415096 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a37128-4164-4737-8901-8f34cbce51ce None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:59.415096 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a37128-4164-4737-8901-8f34cbce51ce None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:59.415096 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a37128-4164-4737-8901-8f34cbce51ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:59.432874 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-d0a37128-4164-4737-8901-8f34cbce51ce None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:13:59.434282 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-d0a37128-4164-4737-8901-8f34cbce51ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:13:59.459789 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d715828-dc17-4582-81f3-8fc493d4eac0 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:59.508095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:59.509595 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025a394-3619-4566-bcfb-5f99dd045d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:59.512019 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025a394-3619-4566-bcfb-5f99dd045d48 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:59.512688 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025a394-3619-4566-bcfb-5f99dd045d48 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:59.512974 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025a394-3619-4566-bcfb-5f99dd045d48 None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:59.513678 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025a394-3619-4566-bcfb-5f99dd045d48 None admin] RBAC: Adding query filter params (type=network) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:59.514216 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025a394-3619-4566-bcfb-5f99dd045d48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:59.515850 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025a394-3619-4566-bcfb-5f99dd045d48 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:59.516729 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 368/710] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:13:59 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:13:59.526890 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 343/711] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Jul 27 20:13:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:59.527746 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a37128-4164-4737-8901-8f34cbce51ce None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:59.542024 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025a394-3619-4566-bcfb-5f99dd045d48 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:59.563254 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:59.645800 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a37128-4164-4737-8901-8f34cbce51ce None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:59.665328 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025a394-3619-4566-bcfb-5f99dd045d48 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:59.685934 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5ed59-2280-4d0e-a574-19d1c04629cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:59.687938 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5ed59-2280-4d0e-a574-19d1c04629cf None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:59.688279 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5ed59-2280-4d0e-a574-19d1c04629cf None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:59.688909 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5ed59-2280-4d0e-a574-19d1c04629cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:59.689744 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5ed59-2280-4d0e-a574-19d1c04629cf None admin] RBAC: Adding query filter params (interface=public, service_id=edadc0594b9a40d98126427bae7ff23c, region_id=RegionOne) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:59.690123 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5ed59-2280-4d0e-a574-19d1c04629cf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:59.691583 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5ed59-2280-4d0e-a574-19d1c04629cf None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:59.699435 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 369/712] 10.222.0.83 () {56 vars in 1251 bytes} [Wed Jul 27 20:13:59 2022] GET /identity/v3/endpoints?service_id=edadc0594b9a40d98126427bae7ff23c&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:59.704494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5ed59-2280-4d0e-a574-19d1c04629cf None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:59.710680 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2652206-cce6-4bb8-a6cf-c6e62c2311c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:59.711361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2652206-cce6-4bb8-a6cf-c6e62c2311c9 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:59.711676 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2652206-cce6-4bb8-a6cf-c6e62c2311c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:59.711963 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2652206-cce6-4bb8-a6cf-c6e62c2311c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:59.722643 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2652206-cce6-4bb8-a6cf-c6e62c2311c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:13:59.729863 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-c2652206-cce6-4bb8-a6cf-c6e62c2311c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:13:59.729863 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:13:59.729863 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:13:59.729863 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:13:59.729863 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:13:59.729863 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:13:59.729863 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:13:59.729863 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:13:59.729863 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:13:59.729863 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:13:59.729863 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:13:59.729863 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:13:59.729863 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:13:59.729863 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:13:59.729863 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:13:59.729863 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:13:59.730817 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:13:59.730817 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:13:59.730817 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:13:59.730817 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:13:59.730817 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:13:59.730817 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:13:59.730817 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:13:59.730817 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:13:59.730817 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:13:59.730817 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:13:59.730817 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:13:59.730817 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:13:59.730817 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:13:59.730817 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:13:59.730817 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:13:59.730817 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:13:59.731893 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:13:59.731893 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:13:59.731893 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:13:59.731893 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:13:59.731893 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:13:59.731893 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:13:59.731893 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:13:59.731893 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:13:59.731893 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:13:59.731893 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:13:59.731893 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:13:59.731893 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:13:59.731893 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 344/713] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 27 20:13:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:13:59.741054 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2652206-cce6-4bb8-a6cf-c6e62c2311c9 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:13:59.776613 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:59.821760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5ed59-2280-4d0e-a574-19d1c04629cf None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:59.836485 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:59.865302 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c559b7c-b133-472b-97c7-ec0b06534ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:59.865910 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c559b7c-b133-472b-97c7-ec0b06534ea6 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:59.866345 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c559b7c-b133-472b-97c7-ec0b06534ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:59.866847 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c559b7c-b133-472b-97c7-ec0b06534ea6 None admin] PATH_INFO: `/v3/services` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:59.867589 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c559b7c-b133-472b-97c7-ec0b06534ea6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:59.869597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c559b7c-b133-472b-97c7-ec0b06534ea6 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:59.870979 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2652206-cce6-4bb8-a6cf-c6e62c2311c9 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:13:59.876742 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 370/714] 10.222.0.83 () {56 vars in 1087 bytes} [Wed Jul 27 20:13:59 2022] GET /identity/v3/services => generated 1002 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 20:13:59.912763 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377af5c8-a537-4a1d-816f-2923a07df64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:13:59.913745 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377af5c8-a537-4a1d-816f-2923a07df64f None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:13:59.914571 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377af5c8-a537-4a1d-816f-2923a07df64f None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:13:59.915091 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377af5c8-a537-4a1d-816f-2923a07df64f None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:13:59.916162 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377af5c8-a537-4a1d-816f-2923a07df64f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:13:59.916664 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377af5c8-a537-4a1d-816f-2923a07df64f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:13:59.918278 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377af5c8-a537-4a1d-816f-2923a07df64f None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:13:59.929453 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 345/715] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:13:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:13:59.935151 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c559b7c-b133-472b-97c7-ec0b06534ea6 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:00.048331 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c559b7c-b133-472b-97c7-ec0b06534ea6 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:00.079286 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:00.089299 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee578f-db18-4365-a13b-67a7a1203aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:00.089939 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee578f-db18-4365-a13b-67a7a1203aa1 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:00.090217 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee578f-db18-4365-a13b-67a7a1203aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:00.090485 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee578f-db18-4365-a13b-67a7a1203aa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:00.101784 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee578f-db18-4365-a13b-67a7a1203aa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:00.107094 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee578f-db18-4365-a13b-67a7a1203aa1 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:00.121001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-fbee578f-db18-4365-a13b-67a7a1203aa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:14:00.121001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:00.121001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:14:00.121001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:14:00.121001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:14:00.121001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:14:00.121001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:14:00.121001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:14:00.121001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:14:00.121001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:14:00.121001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:14:00.121001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:14:00.121001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:14:00.121001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:14:00.121001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:14:00.121925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:14:00.121925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:14:00.121925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:14:00.121925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:14:00.121925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:14:00.121925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:14:00.121925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:14:00.121925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:14:00.121925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:14:00.121925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:14:00.121925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:14:00.121925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:14:00.121925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:14:00.121925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:14:00.121925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:14:00.121925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:14:00.121925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:14:00.123108 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:14:00.123108 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:14:00.123108 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:14:00.123108 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:14:00.123108 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 371/716] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:14:00.129488 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377af5c8-a537-4a1d-816f-2923a07df64f None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:00.232265 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377af5c8-a537-4a1d-816f-2923a07df64f None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:00.278169 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435601d6-e2f8-46ce-9627-80a37760cc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:00.278812 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435601d6-e2f8-46ce-9627-80a37760cc40 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:00.279111 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435601d6-e2f8-46ce-9627-80a37760cc40 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:00.279402 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435601d6-e2f8-46ce-9627-80a37760cc40 None admin] PATH_INFO: `/v3/domains` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:00.280089 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435601d6-e2f8-46ce-9627-80a37760cc40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:00.280398 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435601d6-e2f8-46ce-9627-80a37760cc40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:00.281757 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435601d6-e2f8-46ce-9627-80a37760cc40 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:00.288797 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:00.294287 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 346/717] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:14:00.299943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee578f-db18-4365-a13b-67a7a1203aa1 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:00.419863 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee578f-db18-4365-a13b-67a7a1203aa1 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:00.462280 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c87aa-c9ae-4559-afa7-bf006064401a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:00.463125 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c87aa-c9ae-4559-afa7-bf006064401a None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:00.463417 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c87aa-c9ae-4559-afa7-bf006064401a None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:00.463758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c87aa-c9ae-4559-afa7-bf006064401a None admin] PATH_INFO: `/v3/users/nova` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:00.474753 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c87aa-c9ae-4559-afa7-bf006064401a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:00.476739 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c87aa-c9ae-4559-afa7-bf006064401a None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:00.491979 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-730c87aa-c9ae-4559-afa7-bf006064401a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 20:14:00.491979 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:00.491979 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:14:00.491979 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:14:00.491979 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:14:00.491979 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:14:00.491979 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:14:00.491979 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:14:00.491979 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:14:00.491979 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:14:00.491979 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:14:00.491979 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:14:00.491979 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 20:14:00.491979 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 20:14:00.491979 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 20:14:00.491979 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 20:14:00.492943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:14:00.492943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:14:00.492943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 20:14:00.492943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:14:00.492943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 20:14:00.492943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:14:00.492943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:14:00.492943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:14:00.492943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:14:00.492943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:14:00.492943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:14:00.492943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:14:00.492943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:14:00.492943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:14:00.492943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:14:00.492943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:14:00.492943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:14:00.492943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:14:00.494365 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:14:00.494365 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:14:00.494365 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 20:14:00.494365 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 20:14:00.494365 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 20:14:00.494365 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 20:14:00.494365 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 20:14:00.494365 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 20:14:00.494365 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 20:14:00.494365 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:14:00.494365 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 372/718] 10.222.0.83 () {56 vars in 1093 bytes} [Wed Jul 27 20:14:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:14:00.501570 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435601d6-e2f8-46ce-9627-80a37760cc40 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:00.624884 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435601d6-e2f8-46ce-9627-80a37760cc40 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:00.661062 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182cd64-6743-47c3-aeb6-164288f05c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:00.661764 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182cd64-6743-47c3-aeb6-164288f05c11 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:00.662389 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182cd64-6743-47c3-aeb6-164288f05c11 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:00.662669 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182cd64-6743-47c3-aeb6-164288f05c11 None admin] PATH_INFO: `/v3/users` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:00.663551 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182cd64-6743-47c3-aeb6-164288f05c11 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:00.663863 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182cd64-6743-47c3-aeb6-164288f05c11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:00.665353 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182cd64-6743-47c3-aeb6-164288f05c11 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:00.685183 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 347/719] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Jul 27 20:14:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:14:00.690782 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c87aa-c9ae-4559-afa7-bf006064401a None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:00.733271 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:00.796231 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c87aa-c9ae-4559-afa7-bf006064401a None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:00.831148 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78754f24-290d-4563-aea4-96a5f6843127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:00.831766 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78754f24-290d-4563-aea4-96a5f6843127 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:00.832048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78754f24-290d-4563-aea4-96a5f6843127 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:00.832322 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78754f24-290d-4563-aea4-96a5f6843127 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:00.902547 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78754f24-290d-4563-aea4-96a5f6843127 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:00.904148 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78754f24-290d-4563-aea4-96a5f6843127 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:00.947603 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:01.006373 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 373/720] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:14:00 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 20:14:01.012217 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182cd64-6743-47c3-aeb6-164288f05c11 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:01.068968 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:01.122013 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182cd64-6743-47c3-aeb6-164288f05c11 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:01.157134 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37fd79-c12d-44db-8f95-dde8a608eeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:01.157786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37fd79-c12d-44db-8f95-dde8a608eeb1 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:01.158350 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37fd79-c12d-44db-8f95-dde8a608eeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:01.158627 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37fd79-c12d-44db-8f95-dde8a608eeb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:01.171053 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37fd79-c12d-44db-8f95-dde8a608eeb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:01.172655 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37fd79-c12d-44db-8f95-dde8a608eeb1 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:01.187873 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-ad37fd79-c12d-44db-8f95-dde8a608eeb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:14:01.187873 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:01.187873 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:14:01.187873 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:14:01.187873 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:14:01.187873 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:14:01.187873 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:14:01.187873 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:14:01.187873 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:14:01.187873 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:14:01.187873 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:14:01.187873 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:14:01.187873 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:14:01.187873 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:14:01.187873 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:14:01.188829 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:14:01.188829 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:14:01.188829 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:14:01.188829 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:14:01.188829 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:14:01.188829 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:14:01.188829 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:14:01.188829 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:14:01.188829 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:14:01.188829 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:14:01.188829 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:14:01.188829 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:14:01.188829 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:14:01.188829 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:14:01.188829 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:14:01.188829 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:14:01.188829 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:14:01.190102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:14:01.190102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:14:01.190102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:14:01.190102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:01.190102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 348/721] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:14:01.194995 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78754f24-290d-4563-aea4-96a5f6843127 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:01.261859 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085e930-898b-469c-a242-d9bb3ced28f8 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:01.262177 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085e930-898b-469c-a242-d9bb3ced28f8 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:01.262424 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085e930-898b-469c-a242-d9bb3ced28f8 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:01.264114 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 349/722] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:14:01.275777 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745f368-f837-4bfd-bb1a-9f0027822389 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:01.276249 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745f368-f837-4bfd-bb1a-9f0027822389 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:01.277473 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745f368-f837-4bfd-bb1a-9f0027822389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:01.300742 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-8745f368-f837-4bfd-bb1a-9f0027822389 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:14:01.303597 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-8745f368-f837-4bfd-bb1a-9f0027822389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:14:01.308122 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78754f24-290d-4563-aea4-96a5f6843127 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:01.347719 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3db9d3-aa88-4190-9425-42e5656b7c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:01.349409 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3db9d3-aa88-4190-9425-42e5656b7c70 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:01.349913 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3db9d3-aa88-4190-9425-42e5656b7c70 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:01.350439 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3db9d3-aa88-4190-9425-42e5656b7c70 None admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:01.351328 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3db9d3-aa88-4190-9425-42e5656b7c70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:01.351776 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3db9d3-aa88-4190-9425-42e5656b7c70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:01.354396 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3db9d3-aa88-4190-9425-42e5656b7c70 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:01.363033 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:01.371198 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 374/723] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:14:01.376223 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3db9d3-aa88-4190-9425-42e5656b7c70 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:01.395130 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 350/724] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:14:01 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:14:01.419331 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745f368-f837-4bfd-bb1a-9f0027822389 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:01.462251 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:01.502403 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3db9d3-aa88-4190-9425-42e5656b7c70 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:01.547240 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce82a2-c995-46d8-9da2-833876139fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:01.547240 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce82a2-c995-46d8-9da2-833876139fa7 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:01.547240 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce82a2-c995-46d8-9da2-833876139fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:01.547240 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce82a2-c995-46d8-9da2-833876139fa7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:01.547666 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745f368-f837-4bfd-bb1a-9f0027822389 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:01.554213 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce82a2-c995-46d8-9da2-833876139fa7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:01.556291 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce82a2-c995-46d8-9da2-833876139fa7 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:01.571890 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-9cce82a2-c995-46d8-9da2-833876139fa7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:14:01.571890 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:01.571890 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:14:01.571890 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:14:01.571890 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:14:01.571890 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:14:01.571890 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:14:01.571890 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:14:01.571890 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:14:01.571890 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:14:01.571890 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:14:01.571890 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:14:01.571890 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 20:14:01.571890 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 20:14:01.571890 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 20:14:01.572977 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 20:14:01.572977 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:14:01.572977 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:14:01.572977 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:14:01.572977 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:14:01.572977 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:14:01.572977 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:14:01.572977 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:14:01.572977 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:14:01.572977 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:14:01.572977 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:14:01.572977 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:14:01.572977 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:14:01.572977 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:14:01.572977 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:14:01.572977 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:14:01.572977 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:14:01.574089 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 20:14:01.574089 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 20:14:01.574089 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 20:14:01.574089 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 20:14:01.574089 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 20:14:01.574089 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 20:14:01.574089 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:14:01.574089 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:14:01.576579 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 375/725] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:14:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:14:01.582085 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce82a2-c995-46d8-9da2-833876139fa7 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:01.589993 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc3103-5885-4b37-9ec7-313b0b51a09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:01.590936 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc3103-5885-4b37-9ec7-313b0b51a09e None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:01.591465 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc3103-5885-4b37-9ec7-313b0b51a09e None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:01.592390 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc3103-5885-4b37-9ec7-313b0b51a09e None admin] PATH_INFO: `/v3/services/image` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:01.593250 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc3103-5885-4b37-9ec7-313b0b51a09e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:01.595215 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc3103-5885-4b37-9ec7-313b0b51a09e None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:01.607439 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-b9cc3103-5885-4b37-9ec7-313b0b51a09e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 20:14:01.607439 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:01.607439 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 20:14:01.607439 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 20:14:01.607439 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 20:14:01.607439 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 20:14:01.607439 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 20:14:01.607439 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:14:01.607439 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 20:14:01.607439 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:01.607439 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 20:14:01.607439 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:01.607439 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:01.607439 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:14:01.607439 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:14:01.607439 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:14:01.607439 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:14:01.608613 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:14:01.608613 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:14:01.608613 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:14:01.608613 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:14:01.608613 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:14:01.608613 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:14:01.608613 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 20:14:01.608613 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 20:14:01.608613 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 20:14:01.608613 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 20:14:01.608613 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:14:01.608613 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:14:01.608613 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:14:01.608613 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:14:01.608613 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:14:01.608613 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:14:01.609633 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:14:01.609633 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:14:01.609633 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:14:01.609633 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:14:01.609633 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:14:01.609633 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:14:01.609633 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:14:01.609633 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:14:01.609633 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:14:01.609633 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:14:01.609633 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 20:14:01.609633 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:14:01.609633 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 20:14:01.609633 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:01.618001 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 351/726] 10.222.0.83 () {56 vars in 1105 bytes} [Wed Jul 27 20:14:01 2022] GET /identity/v3/services/image => generated 86 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:14:01.620099 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc3103-5885-4b37-9ec7-313b0b51a09e None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:01.655457 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:01.698299 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce82a2-c995-46d8-9da2-833876139fa7 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:01.734420 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:01.735684 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fddd97-0a46-4493-8964-c06f9edeed26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:01.736416 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fddd97-0a46-4493-8964-c06f9edeed26 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:01.736599 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fddd97-0a46-4493-8964-c06f9edeed26 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:01.736863 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fddd97-0a46-4493-8964-c06f9edeed26 None admin] PATH_INFO: `/v3/projects` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:01.737606 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fddd97-0a46-4493-8964-c06f9edeed26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:01.737913 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fddd97-0a46-4493-8964-c06f9edeed26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:01.740116 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fddd97-0a46-4493-8964-c06f9edeed26 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:01.741221 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc3103-5885-4b37-9ec7-313b0b51a09e None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:01.760113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 376/727] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 27 20:14:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:14:01.761065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fddd97-0a46-4493-8964-c06f9edeed26 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:01.778051 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d941c-7ed8-46f8-a2f8-0a0ff9d46d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:01.779004 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d941c-7ed8-46f8-a2f8-0a0ff9d46d30 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:01.779521 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d941c-7ed8-46f8-a2f8-0a0ff9d46d30 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:01.779994 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d941c-7ed8-46f8-a2f8-0a0ff9d46d30 None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:01.780884 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d941c-7ed8-46f8-a2f8-0a0ff9d46d30 None admin] RBAC: Adding query filter params (name=image) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:01.781412 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d941c-7ed8-46f8-a2f8-0a0ff9d46d30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:01.782969 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d941c-7ed8-46f8-a2f8-0a0ff9d46d30 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:01.793231 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 352/728] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:14:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:14:01.794605 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d941c-7ed8-46f8-a2f8-0a0ff9d46d30 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:01.868065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fddd97-0a46-4493-8964-c06f9edeed26 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:01.886575 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:01.902975 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d941c-7ed8-46f8-a2f8-0a0ff9d46d30 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:01.905235 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b24bd1-d09c-4291-a731-f8c6fad588c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:01.905851 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b24bd1-d09c-4291-a731-f8c6fad588c6 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:01.906133 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b24bd1-d09c-4291-a731-f8c6fad588c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:01.906403 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b24bd1-d09c-4291-a731-f8c6fad588c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:01.907203 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b24bd1-d09c-4291-a731-f8c6fad588c6 None admin] RBAC: Adding query filter params (role.id=df8ec36d044b469d8854eba8394eb107, scope.project.id=75313278ff3747909a57b6f37496d31e, user.id=f68b37524d7245e4b606ad8dd15442ef) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:01.907512 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b24bd1-d09c-4291-a731-f8c6fad588c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:01.908970 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b24bd1-d09c-4291-a731-f8c6fad588c6 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:01.916378 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 377/729] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:14:01 2022] GET /identity/v3/role_assignments?user.id=f68b37524d7245e4b606ad8dd15442ef&scope.project.id=75313278ff3747909a57b6f37496d31e&role.id=df8ec36d044b469d8854eba8394eb107 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:14:01.925268 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e96cdd-becd-40d0-a3c1-96f05ee922fc None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:01.926079 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e96cdd-becd-40d0-a3c1-96f05ee922fc None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:01.926653 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e96cdd-becd-40d0-a3c1-96f05ee922fc None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:01.934519 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 378/730] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:14:01 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:14:01.936805 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badffc0-9dd9-4eb9-b91d-a2be10d38f78 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:01.937918 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badffc0-9dd9-4eb9-b91d-a2be10d38f78 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:01.938717 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badffc0-9dd9-4eb9-b91d-a2be10d38f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:01.946330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9735f-5f8f-4978-96ec-baf794999859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:01.947150 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9735f-5f8f-4978-96ec-baf794999859 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:01.947507 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9735f-5f8f-4978-96ec-baf794999859 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:01.947854 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9735f-5f8f-4978-96ec-baf794999859 None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:01.948652 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9735f-5f8f-4978-96ec-baf794999859 None admin] RBAC: Adding query filter params (type=image) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:01.949030 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9735f-5f8f-4978-96ec-baf794999859 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:01.950586 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9735f-5f8f-4978-96ec-baf794999859 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:01.961542 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 353/731] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:14:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:14:01.962868 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9735f-5f8f-4978-96ec-baf794999859 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:01.963638 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-0badffc0-9dd9-4eb9-b91d-a2be10d38f78 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:14:01.965032 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-0badffc0-9dd9-4eb9-b91d-a2be10d38f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:14:01.996054 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:02.063609 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 379/732] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:14:01 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:14:02.081054 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9735f-5f8f-4978-96ec-baf794999859 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:02.082485 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badffc0-9dd9-4eb9-b91d-a2be10d38f78 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:02.125813 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca46cd-2507-43ab-a0d5-c3a3c6bdeed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:02.126380 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca46cd-2507-43ab-a0d5-c3a3c6bdeed8 None admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:02.126664 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca46cd-2507-43ab-a0d5-c3a3c6bdeed8 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:02.126940 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca46cd-2507-43ab-a0d5-c3a3c6bdeed8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:02.127761 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca46cd-2507-43ab-a0d5-c3a3c6bdeed8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:02.129157 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca46cd-2507-43ab-a0d5-c3a3c6bdeed8 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:02.157063 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 354/733] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Jul 27 20:14:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 20:14:02.184030 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fd089-c533-48af-879d-42041decc664 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:02.184030 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fd089-c533-48af-879d-42041decc664 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:02.184030 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fd089-c533-48af-879d-42041decc664 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:02.185496 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 355/734] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 20:14:02.191117 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7aa14e-e15e-44ba-94ac-3cf6d8ce9d04 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:02.191435 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7aa14e-e15e-44ba-94ac-3cf6d8ce9d04 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:02.191676 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7aa14e-e15e-44ba-94ac-3cf6d8ce9d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:02.222500 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-3b7aa14e-e15e-44ba-94ac-3cf6d8ce9d04 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:14:02.224748 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badffc0-9dd9-4eb9-b91d-a2be10d38f78 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:02.225131 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-3b7aa14e-e15e-44ba-94ac-3cf6d8ce9d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:14:02.241344 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:02.276095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d6e8a-feb7-4c01-a31a-33dad462acef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:02.277072 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d6e8a-feb7-4c01-a31a-33dad462acef None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:02.277642 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d6e8a-feb7-4c01-a31a-33dad462acef None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:02.278106 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d6e8a-feb7-4c01-a31a-33dad462acef None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:02.279993 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d6e8a-feb7-4c01-a31a-33dad462acef None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:02.282041 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d6e8a-feb7-4c01-a31a-33dad462acef None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:02.295218 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-820d6e8a-feb7-4c01-a31a-33dad462acef None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 20:14:02.295218 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:02.295218 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 20:14:02.295218 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 20:14:02.295218 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 20:14:02.295218 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 20:14:02.295218 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 20:14:02.295218 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:14:02.295218 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 20:14:02.295218 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:14:02.295218 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 20:14:02.295218 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:14:02.295218 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:02.295218 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:14:02.295218 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:14:02.295218 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:14:02.296232 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:14:02.296232 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:14:02.296232 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:14:02.296232 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:14:02.296232 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:14:02.296232 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:14:02.296232 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:14:02.296232 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 20:14:02.296232 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 20:14:02.296232 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 20:14:02.296232 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 20:14:02.296232 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:14:02.296232 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:14:02.296232 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:14:02.296232 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:14:02.296232 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:14:02.297077 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:14:02.297077 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:14:02.297077 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:14:02.297077 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:14:02.297077 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:14:02.297077 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:14:02.297077 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:14:02.297077 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:14:02.297077 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:14:02.297077 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:14:02.297077 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:14:02.297077 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 20:14:02.297077 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:14:02.297077 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 20:14:02.297077 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:14:02.304881 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 380/735] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Jul 27 20:14:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:14:02.306136 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d6e8a-feb7-4c01-a31a-33dad462acef None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:02.314992 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 356/736] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:14:02 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 20:14:02.343049 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7aa14e-e15e-44ba-94ac-3cf6d8ce9d04 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:02.359791 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:02.432541 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d6e8a-feb7-4c01-a31a-33dad462acef None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:02.471446 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7aa14e-e15e-44ba-94ac-3cf6d8ce9d04 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:02.484981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16892da6-b128-4e21-9762-632b25024707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:02.486115 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16892da6-b128-4e21-9762-632b25024707 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:02.486578 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16892da6-b128-4e21-9762-632b25024707 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:02.487455 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16892da6-b128-4e21-9762-632b25024707 None admin] PATH_INFO: `/v3/services` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:02.488156 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16892da6-b128-4e21-9762-632b25024707 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:02.488470 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16892da6-b128-4e21-9762-632b25024707 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:02.489887 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16892da6-b128-4e21-9762-632b25024707 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:02.497757 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 381/737] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Jul 27 20:14:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:14:02.504265 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16892da6-b128-4e21-9762-632b25024707 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:02.524093 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d29b6-aa43-4b36-9597-83185399303e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:02.525370 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d29b6-aa43-4b36-9597-83185399303e None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:02.526282 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d29b6-aa43-4b36-9597-83185399303e None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:02.526766 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d29b6-aa43-4b36-9597-83185399303e None admin] PATH_INFO: `/v3/services/network` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:02.527635 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d29b6-aa43-4b36-9597-83185399303e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:02.529766 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d29b6-aa43-4b36-9597-83185399303e None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:02.543775 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:02.544828 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-ae7d29b6-aa43-4b36-9597-83185399303e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 20:14:02.544828 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:02.544828 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 20:14:02.544828 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 20:14:02.544828 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 20:14:02.544828 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 20:14:02.544828 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 20:14:02.544828 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:14:02.544828 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 20:14:02.544828 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:02.544828 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 20:14:02.544828 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:02.544828 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:02.544828 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:14:02.544828 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:14:02.544828 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:14:02.544828 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:14:02.545781 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:14:02.545781 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:14:02.545781 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:14:02.545781 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:14:02.545781 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:14:02.545781 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:14:02.545781 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 20:14:02.545781 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 20:14:02.545781 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 20:14:02.545781 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 20:14:02.545781 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:14:02.545781 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:14:02.545781 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:14:02.545781 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:14:02.545781 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:14:02.545781 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:14:02.546621 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:14:02.546621 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:14:02.546621 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:14:02.546621 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:14:02.546621 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:14:02.546621 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:14:02.546621 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:14:02.546621 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:14:02.546621 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:14:02.546621 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:14:02.546621 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 20:14:02.546621 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:14:02.546621 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 20:14:02.546621 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:02.549737 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 357/738] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:14:02 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:14:02.555383 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d29b6-aa43-4b36-9597-83185399303e None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:02.630984 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16892da6-b128-4e21-9762-632b25024707 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:02.648802 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:02.669383 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dba2e-8462-449f-9850-ad579cb7ead6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:02.670667 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dba2e-8462-449f-9850-ad579cb7ead6 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:02.671499 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dba2e-8462-449f-9850-ad579cb7ead6 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:02.671959 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dba2e-8462-449f-9850-ad579cb7ead6 None admin] PATH_INFO: `/v3/services` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:02.673077 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2dba2e-8462-449f-9850-ad579cb7ead6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:02.673904 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2dba2e-8462-449f-9850-ad579cb7ead6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:02.675732 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2dba2e-8462-449f-9850-ad579cb7ead6 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:02.676265 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d29b6-aa43-4b36-9597-83185399303e None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:02.687515 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 382/739] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Jul 27 20:14:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:14:02.689804 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dba2e-8462-449f-9850-ad579cb7ead6 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:02.725201 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e00b8-6ac3-40da-af57-c76726d096bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:02.726182 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e00b8-6ac3-40da-af57-c76726d096bc None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:02.726693 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e00b8-6ac3-40da-af57-c76726d096bc None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:02.727198 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e00b8-6ac3-40da-af57-c76726d096bc None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:02.728074 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e00b8-6ac3-40da-af57-c76726d096bc None admin] RBAC: Adding query filter params (name=network) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:02.728582 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e00b8-6ac3-40da-af57-c76726d096bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:02.730247 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e00b8-6ac3-40da-af57-c76726d096bc None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:02.735689 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 358/740] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Jul 27 20:14:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:14:02.742045 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e00b8-6ac3-40da-af57-c76726d096bc None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:02.829496 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:02.835636 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dba2e-8462-449f-9850-ad579cb7ead6 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:02.854496 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e00b8-6ac3-40da-af57-c76726d096bc None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:02.872722 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6473558-252c-462b-b5b6-2fb01037f90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:02.873726 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6473558-252c-462b-b5b6-2fb01037f90f None admin] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:02.874109 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6473558-252c-462b-b5b6-2fb01037f90f None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:02.874907 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6473558-252c-462b-b5b6-2fb01037f90f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:02.876046 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6473558-252c-462b-b5b6-2fb01037f90f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:02.877534 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6473558-252c-462b-b5b6-2fb01037f90f None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:02.895293 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d22c2b-54c8-4c20-bc6e-c2cc3e338691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:02.896011 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d22c2b-54c8-4c20-bc6e-c2cc3e338691 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:02.897642 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d22c2b-54c8-4c20-bc6e-c2cc3e338691 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:02.897642 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d22c2b-54c8-4c20-bc6e-c2cc3e338691 None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:02.897831 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d22c2b-54c8-4c20-bc6e-c2cc3e338691 None admin] RBAC: Adding query filter params (type=network) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:02.898132 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d22c2b-54c8-4c20-bc6e-c2cc3e338691 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:02.899559 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d22c2b-54c8-4c20-bc6e-c2cc3e338691 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:02.910773 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 383/741] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Jul 27 20:14:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:14:02.911354 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 359/742] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Jul 27 20:14:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:14:02.911697 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6473558-252c-462b-b5b6-2fb01037f90f None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:03.032594 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6473558-252c-462b-b5b6-2fb01037f90f None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:03.069474 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9ff2a-03c4-41b5-a4a6-9b5dd4fcfddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:03.070117 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9ff2a-03c4-41b5-a4a6-9b5dd4fcfddb None admin] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:03.070398 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9ff2a-03c4-41b5-a4a6-9b5dd4fcfddb None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:03.070674 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9ff2a-03c4-41b5-a4a6-9b5dd4fcfddb None admin] PATH_INFO: `/v3/endpoints` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:03.071423 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9ff2a-03c4-41b5-a4a6-9b5dd4fcfddb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:03.072841 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9ff2a-03c4-41b5-a4a6-9b5dd4fcfddb None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:03.102308 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 384/743] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Jul 27 20:14:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:14:04.312698 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1368433-77d3-45ab-8b9c-9e9b0c5b7b46 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:04.312698 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1368433-77d3-45ab-8b9c-9e9b0c5b7b46 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:04.312698 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1368433-77d3-45ab-8b9c-9e9b0c5b7b46 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:04.312698 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 360/744] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:14:04.319351 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32267990-8353-4c4f-9858-60242cbcf67b None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:04.319767 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32267990-8353-4c4f-9858-60242cbcf67b None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:04.319909 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32267990-8353-4c4f-9858-60242cbcf67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:04.338796 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-32267990-8353-4c4f-9858-60242cbcf67b None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:14:04.340124 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-32267990-8353-4c4f-9858-60242cbcf67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:14:04.342379 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:04.431867 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 385/745] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:14:04 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:14:04.455466 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1368433-77d3-45ab-8b9c-9e9b0c5b7b46 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:04.459337 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:04.558955 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1368433-77d3-45ab-8b9c-9e9b0c5b7b46 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:04.559686 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb9dd8-fda3-4e09-8766-1dd8a5922d5e None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:04.559977 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb9dd8-fda3-4e09-8766-1dd8a5922d5e None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:04.560250 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb9dd8-fda3-4e09-8766-1dd8a5922d5e None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:04.561730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 386/746] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:14:04.566686 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf3e5e-504c-4fb3-af75-70075011558d None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:04.566910 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf3e5e-504c-4fb3-af75-70075011558d None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:04.567795 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf3e5e-504c-4fb3-af75-70075011558d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:04.585325 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-d9bf3e5e-504c-4fb3-af75-70075011558d None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:14:04.586503 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-d9bf3e5e-504c-4fb3-af75-70075011558d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:14:04.596887 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b659f-4098-471f-a376-ff3e7d66f721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:04.597844 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b659f-4098-471f-a376-ff3e7d66f721 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:04.598129 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b659f-4098-471f-a376-ff3e7d66f721 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:04.598438 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b659f-4098-471f-a376-ff3e7d66f721 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:04.599064 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b659f-4098-471f-a376-ff3e7d66f721 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:04.600445 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b659f-4098-471f-a376-ff3e7d66f721 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:04.609396 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-115b659f-4098-471f-a376-ff3e7d66f721 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 20:14:04.609396 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:04.609396 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 20:14:04.609396 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 20:14:04.609396 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 20:14:04.609396 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 20:14:04.609396 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 20:14:04.609396 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:14:04.609396 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 20:14:04.609396 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:04.609396 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 20:14:04.609396 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:04.609396 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:04.609396 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:14:04.609396 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:14:04.609396 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:14:04.610366 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:14:04.610366 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:14:04.610366 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:14:04.610366 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:14:04.610366 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:14:04.610366 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:14:04.610366 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:14:04.610366 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 20:14:04.610366 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 20:14:04.610366 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 20:14:04.610366 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 20:14:04.610366 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:14:04.610366 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:14:04.610366 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:14:04.610366 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:14:04.610366 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:14:04.611271 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:14:04.611271 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:14:04.611271 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:14:04.611271 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:14:04.611271 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:14:04.611271 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:14:04.611271 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:14:04.611271 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:14:04.611271 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:14:04.611271 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:14:04.611271 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:14:04.611271 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 20:14:04.611271 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:14:04.611271 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 20:14:04.611271 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:04.611271 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 361/747] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Jul 27 20:14:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:14:04.616887 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b659f-4098-471f-a376-ff3e7d66f721 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:04.664126 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 387/748] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:14:04 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 20:14:04.683648 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:04.688460 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf3e5e-504c-4fb3-af75-70075011558d None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:04.722493 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b659f-4098-471f-a376-ff3e7d66f721 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:04.754845 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:04.757495 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fc089-0668-4175-a26a-cc1602c22e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:04.758172 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fc089-0668-4175-a26a-cc1602c22e1f None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:04.758456 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fc089-0668-4175-a26a-cc1602c22e1f None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:04.758728 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fc089-0668-4175-a26a-cc1602c22e1f None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:04.759434 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fc089-0668-4175-a26a-cc1602c22e1f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:04.759745 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fc089-0668-4175-a26a-cc1602c22e1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:04.761112 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fc089-0668-4175-a26a-cc1602c22e1f None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:04.770224 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 362/749] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Jul 27 20:14:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:14:04.771469 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fc089-0668-4175-a26a-cc1602c22e1f None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:04.800543 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf3e5e-504c-4fb3-af75-70075011558d None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:04.834732 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8cce5-1c58-4a82-8d09-e22f5da697b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:04.835405 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8cce5-1c58-4a82-8d09-e22f5da697b3 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:04.835681 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8cce5-1c58-4a82-8d09-e22f5da697b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:04.835956 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8cce5-1c58-4a82-8d09-e22f5da697b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:04.877152 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fc089-0668-4175-a26a-cc1602c22e1f None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:04.907296 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:04.910641 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8cce5-1c58-4a82-8d09-e22f5da697b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:04.913889 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a71ce-1b37-4882-9fce-465c342008cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:04.914041 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8cce5-1c58-4a82-8d09-e22f5da697b3 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:04.914388 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a71ce-1b37-4882-9fce-465c342008cd None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:04.914733 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a71ce-1b37-4882-9fce-465c342008cd None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:04.915043 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a71ce-1b37-4882-9fce-465c342008cd None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:04.916085 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a71ce-1b37-4882-9fce-465c342008cd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:04.917700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a71ce-1b37-4882-9fce-465c342008cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:04.919650 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a71ce-1b37-4882-9fce-465c342008cd None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:04.924396 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 363/750] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Jul 27 20:14:04 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:14:04.982377 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:05.026711 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 388/751] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:14:04 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 20:14:05.032636 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a71ce-1b37-4882-9fce-465c342008cd None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:05.146074 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a71ce-1b37-4882-9fce-465c342008cd None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:05.180082 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104fa53-1588-47c4-8e5c-0306fd7ee3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:05.180714 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104fa53-1588-47c4-8e5c-0306fd7ee3b1 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:05.180989 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104fa53-1588-47c4-8e5c-0306fd7ee3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:05.181256 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104fa53-1588-47c4-8e5c-0306fd7ee3b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:05.191973 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104fa53-1588-47c4-8e5c-0306fd7ee3b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:05.193440 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104fa53-1588-47c4-8e5c-0306fd7ee3b1 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:05.207377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-2104fa53-1588-47c4-8e5c-0306fd7ee3b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:14:05.207377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:05.207377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:14:05.207377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:14:05.207377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:14:05.207377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:14:05.207377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:14:05.207377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:14:05.207377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:14:05.207377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:14:05.207377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:14:05.207377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:14:05.207377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:14:05.207377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:14:05.207377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:14:05.209018 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:14:05.209018 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:14:05.209018 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:14:05.209018 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:14:05.209018 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:14:05.209018 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:14:05.209018 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:14:05.209018 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:14:05.209018 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:14:05.209018 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:14:05.209018 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:14:05.209018 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:14:05.209018 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:14:05.209018 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:14:05.209018 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:14:05.209018 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:14:05.209018 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:14:05.210131 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:14:05.210131 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:14:05.210131 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:14:05.210131 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:05.210131 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 364/752] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:14:05.216346 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8cce5-1c58-4a82-8d09-e22f5da697b3 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:05.239598 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c27ea5-8899-4b99-aff6-efb48544ea86 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:05.239891 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c27ea5-8899-4b99-aff6-efb48544ea86 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:05.240214 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c27ea5-8899-4b99-aff6-efb48544ea86 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:05.241757 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 365/753] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 20:14:05.246893 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f89582-98d8-47ed-988c-b46d662b5ca2 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:05.247235 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f89582-98d8-47ed-988c-b46d662b5ca2 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:05.247515 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f89582-98d8-47ed-988c-b46d662b5ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:05.265795 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-93f89582-98d8-47ed-988c-b46d662b5ca2 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:14:05.266988 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-93f89582-98d8-47ed-988c-b46d662b5ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:14:05.313459 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:05.330644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8cce5-1c58-4a82-8d09-e22f5da697b3 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:05.341154 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 366/754] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:14:05 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 20:14:05.364547 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f89582-98d8-47ed-988c-b46d662b5ca2 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:05.370661 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d6dc8-dec8-42e1-8c24-7c31e2db5a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:05.371339 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d6dc8-dec8-42e1-8c24-7c31e2db5a1c None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:05.371622 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d6dc8-dec8-42e1-8c24-7c31e2db5a1c None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:05.371898 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d6dc8-dec8-42e1-8c24-7c31e2db5a1c None admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:05.372581 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d6dc8-dec8-42e1-8c24-7c31e2db5a1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:05.372899 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d6dc8-dec8-42e1-8c24-7c31e2db5a1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:05.374528 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d6dc8-dec8-42e1-8c24-7c31e2db5a1c None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:05.386446 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 389/755] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:14:05.483345 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f89582-98d8-47ed-988c-b46d662b5ca2 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:05.520210 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bb716-d6c7-449e-8e62-9fe87a8997ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:05.521375 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bb716-d6c7-449e-8e62-9fe87a8997ab None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:05.521657 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bb716-d6c7-449e-8e62-9fe87a8997ab None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:05.521930 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bb716-d6c7-449e-8e62-9fe87a8997ab None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:05.522568 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bb716-d6c7-449e-8e62-9fe87a8997ab None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:05.523992 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bb716-d6c7-449e-8e62-9fe87a8997ab None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:05.533489 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-629bb716-d6c7-449e-8e62-9fe87a8997ab None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 20:14:05.533489 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:05.533489 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 20:14:05.533489 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 20:14:05.533489 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 20:14:05.533489 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 20:14:05.533489 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 20:14:05.533489 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:14:05.533489 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 20:14:05.533489 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:05.533489 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 20:14:05.533489 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:05.533489 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:05.533489 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:14:05.533489 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:14:05.533489 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:14:05.533489 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:14:05.534567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:14:05.534567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:14:05.534567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:14:05.534567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:14:05.534567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:14:05.534567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:14:05.534567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 20:14:05.534567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 20:14:05.534567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 20:14:05.534567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 20:14:05.534567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:14:05.534567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:14:05.534567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:14:05.534567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:14:05.534567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:14:05.534567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:14:05.535890 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:14:05.535890 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:14:05.535890 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:14:05.535890 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:14:05.535890 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:14:05.535890 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:14:05.535890 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:14:05.535890 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:14:05.535890 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:14:05.535890 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:14:05.535890 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 20:14:05.535890 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:14:05.535890 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 20:14:05.535890 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:05.539486 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 367/756] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 27 20:14:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:14:05.541262 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d6dc8-dec8-42e1-8c24-7c31e2db5a1c None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:05.568775 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:05.648803 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d6dc8-dec8-42e1-8c24-7c31e2db5a1c None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:05.682442 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a6c6d-b24f-40e4-87d2-d1fb377907da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:05.683294 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a6c6d-b24f-40e4-87d2-d1fb377907da None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:05.683577 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a6c6d-b24f-40e4-87d2-d1fb377907da None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:05.683899 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a6c6d-b24f-40e4-87d2-d1fb377907da None admin] PATH_INFO: `/v3/services` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:05.684575 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a6c6d-b24f-40e4-87d2-d1fb377907da None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:05.684878 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a6c6d-b24f-40e4-87d2-d1fb377907da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:05.686459 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a6c6d-b24f-40e4-87d2-d1fb377907da None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:05.691609 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 390/757] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 27 20:14:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:14:05.698065 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bb716-d6c7-449e-8e62-9fe87a8997ab None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:05.742748 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:05.797921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bb716-d6c7-449e-8e62-9fe87a8997ab None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:05.830616 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c463c97-a073-43be-8f4b-ff9d6a6ce737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:05.831254 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c463c97-a073-43be-8f4b-ff9d6a6ce737 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:05.831536 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c463c97-a073-43be-8f4b-ff9d6a6ce737 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:05.831811 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c463c97-a073-43be-8f4b-ff9d6a6ce737 None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:05.832472 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c463c97-a073-43be-8f4b-ff9d6a6ce737 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:05.832802 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c463c97-a073-43be-8f4b-ff9d6a6ce737 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:05.834168 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c463c97-a073-43be-8f4b-ff9d6a6ce737 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:05.838434 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 368/758] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 27 20:14:05 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:14:07.188973 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae271d-adda-4de1-a75b-f68851fdc905 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:07.189505 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae271d-adda-4de1-a75b-f68851fdc905 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:07.189633 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae271d-adda-4de1-a75b-f68851fdc905 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:07.190973 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 391/759] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:14:07.196686 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5315497-c9ad-497c-ac85-c9c6c4468455 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:07.197092 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5315497-c9ad-497c-ac85-c9c6c4468455 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:07.197229 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5315497-c9ad-497c-ac85-c9c6c4468455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:07.215982 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-d5315497-c9ad-497c-ac85-c9c6c4468455 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:14:07.217174 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-d5315497-c9ad-497c-ac85-c9c6c4468455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:14:07.281047 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 369/760] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:14:07 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:14:07.305420 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae271d-adda-4de1-a75b-f68851fdc905 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:07.392249 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:07.405450 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae271d-adda-4de1-a75b-f68851fdc905 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:07.437605 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb688feb-c7b3-4f3f-8bcb-7177d938fec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:07.438213 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb688feb-c7b3-4f3f-8bcb-7177d938fec6 None admin] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:07.438492 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb688feb-c7b3-4f3f-8bcb-7177d938fec6 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:07.438765 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb688feb-c7b3-4f3f-8bcb-7177d938fec6 None admin] PATH_INFO: `/v3/services` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:07.439539 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb688feb-c7b3-4f3f-8bcb-7177d938fec6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:07.440886 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb688feb-c7b3-4f3f-8bcb-7177d938fec6 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:07.456517 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 392/761] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Jul 27 20:14:07 2022] POST /identity/v3/services => generated 269 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:14:08.115022 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa88fe-b57a-49e8-a690-d21a916d8260 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:08.115336 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa88fe-b57a-49e8-a690-d21a916d8260 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:08.115611 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa88fe-b57a-49e8-a690-d21a916d8260 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:08.116966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 370/762] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:14:08.122241 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649034e-88c6-4d0d-ab15-9af65af472d9 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:08.122589 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649034e-88c6-4d0d-ab15-9af65af472d9 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:08.122929 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649034e-88c6-4d0d-ab15-9af65af472d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:08.140858 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-7649034e-88c6-4d0d-ab15-9af65af472d9 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:14:08.141984 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-7649034e-88c6-4d0d-ab15-9af65af472d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:14:08.213366 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 393/763] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:14:08 2022] POST /identity/v3/auth/tokens => generated 1506 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:14:08.237152 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa88fe-b57a-49e8-a690-d21a916d8260 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:08.273808 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:08.340236 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa88fe-b57a-49e8-a690-d21a916d8260 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:08.373240 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4c98f-660f-452c-bdc4-8fcf030429f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:08.373790 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4c98f-660f-452c-bdc4-8fcf030429f7 None admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:08.374337 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4c98f-660f-452c-bdc4-8fcf030429f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:08.374609 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4c98f-660f-452c-bdc4-8fcf030429f7 None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:08.375327 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4c98f-660f-452c-bdc4-8fcf030429f7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:08.376720 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4c98f-660f-452c-bdc4-8fcf030429f7 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:08.390961 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 371/764] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Jul 27 20:14:08 2022] POST /identity/v3/services => generated 251 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:14:09.717191 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f73164-bf3e-4283-899d-e5c2c766ee07 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:09.717714 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f73164-bf3e-4283-899d-e5c2c766ee07 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:09.717714 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f73164-bf3e-4283-899d-e5c2c766ee07 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:09.719098 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 394/765] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:14:09.724855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f334b-021b-4b35-93e2-2d389058adba None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:09.725256 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f334b-021b-4b35-93e2-2d389058adba None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:09.725470 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f334b-021b-4b35-93e2-2d389058adba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:09.743127 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-a73f334b-021b-4b35-93e2-2d389058adba None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:14:09.744297 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-a73f334b-021b-4b35-93e2-2d389058adba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:14:09.813694 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 372/766] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:14:09 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:14:09.837408 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f73164-bf3e-4283-899d-e5c2c766ee07 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:09.916409 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:09.942103 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f73164-bf3e-4283-899d-e5c2c766ee07 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:09.975043 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cd2da-5fa7-460c-860d-d25b3511a942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:09.975643 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cd2da-5fa7-460c-860d-d25b3511a942 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:09.975925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cd2da-5fa7-460c-860d-d25b3511a942 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:09.976197 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cd2da-5fa7-460c-860d-d25b3511a942 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:09.976815 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991cd2da-5fa7-460c-860d-d25b3511a942 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:09.978184 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991cd2da-5fa7-460c-860d-d25b3511a942 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:09.986846 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-991cd2da-5fa7-460c-860d-d25b3511a942 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 20:14:09.986846 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:09.986846 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 20:14:09.986846 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 20:14:09.986846 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 20:14:09.986846 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 20:14:09.986846 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 20:14:09.986846 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:14:09.986846 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 20:14:09.986846 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:14:09.986846 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 20:14:09.986846 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:14:09.986846 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:09.986846 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:14:09.986846 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:14:09.986846 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:14:09.987803 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:14:09.987803 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:14:09.987803 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:14:09.987803 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:14:09.987803 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:14:09.987803 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:14:09.987803 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:14:09.987803 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 20:14:09.987803 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 20:14:09.987803 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 20:14:09.987803 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 20:14:09.987803 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:14:09.987803 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:14:09.987803 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:14:09.987803 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:14:09.987803 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:14:09.988719 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:14:09.988719 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:14:09.988719 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:14:09.988719 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:14:09.988719 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:14:09.988719 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:14:09.988719 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:14:09.988719 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:14:09.988719 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:14:09.988719 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:14:09.988719 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:14:09.988719 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 20:14:09.988719 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:14:09.988719 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 20:14:09.988719 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:14:09.988719 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 395/767] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Jul 27 20:14:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:14:09.994395 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f334b-021b-4b35-93e2-2d389058adba None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:10.019250 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:10.093612 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f334b-021b-4b35-93e2-2d389058adba None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:10.126109 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170cf891-1eb0-4cc3-bc9f-812ccd3c3eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:10.126727 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cf891-1eb0-4cc3-bc9f-812ccd3c3eec None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:10.127006 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cf891-1eb0-4cc3-bc9f-812ccd3c3eec None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:10.127307 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cf891-1eb0-4cc3-bc9f-812ccd3c3eec None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:10.127977 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170cf891-1eb0-4cc3-bc9f-812ccd3c3eec None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:10.128279 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170cf891-1eb0-4cc3-bc9f-812ccd3c3eec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:10.130193 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170cf891-1eb0-4cc3-bc9f-812ccd3c3eec None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:10.134757 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 373/768] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Jul 27 20:14:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:14:10.140400 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cd2da-5fa7-460c-860d-d25b3511a942 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:10.237917 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cd2da-5fa7-460c-860d-d25b3511a942 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:10.270900 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8dc79c-b54e-40ac-80a5-58de32b5d885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:10.271541 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dc79c-b54e-40ac-80a5-58de32b5d885 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:10.271819 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dc79c-b54e-40ac-80a5-58de32b5d885 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:10.272090 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dc79c-b54e-40ac-80a5-58de32b5d885 None admin] PATH_INFO: `/v3/services` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:10.272757 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8dc79c-b54e-40ac-80a5-58de32b5d885 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:10.273061 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8dc79c-b54e-40ac-80a5-58de32b5d885 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:10.274427 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8dc79c-b54e-40ac-80a5-58de32b5d885 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:10.279119 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 396/769] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Jul 27 20:14:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:14:10.285066 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170cf891-1eb0-4cc3-bc9f-812ccd3c3eec None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:10.372958 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:10.388817 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170cf891-1eb0-4cc3-bc9f-812ccd3c3eec None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:10.424802 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b95f4-8c81-4f40-901a-4ed5c958f510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:10.425422 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b95f4-8c81-4f40-901a-4ed5c958f510 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:10.425705 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b95f4-8c81-4f40-901a-4ed5c958f510 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:10.426517 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b95f4-8c81-4f40-901a-4ed5c958f510 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:10.427294 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b95f4-8c81-4f40-901a-4ed5c958f510 None admin] RBAC: Adding query filter params (interface=public, service_id=d9ad87f6b4d04dbb85a0cabe2d123413, region_id=RegionOne) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:10.427752 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b95f4-8c81-4f40-901a-4ed5c958f510 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:10.431529 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b95f4-8c81-4f40-901a-4ed5c958f510 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:10.437498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 374/770] 10.222.0.83 () {56 vars in 1251 bytes} [Wed Jul 27 20:14:10 2022] GET /identity/v3/endpoints?service_id=d9ad87f6b4d04dbb85a0cabe2d123413&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:14:10.443596 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8dc79c-b54e-40ac-80a5-58de32b5d885 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:10.446409 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:10.545136 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8dc79c-b54e-40ac-80a5-58de32b5d885 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:10.577787 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823973cc-dd86-42fd-bbba-b63783ea7e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:10.578397 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823973cc-dd86-42fd-bbba-b63783ea7e69 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:10.578677 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823973cc-dd86-42fd-bbba-b63783ea7e69 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:10.578952 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823973cc-dd86-42fd-bbba-b63783ea7e69 None admin] PATH_INFO: `/v3/services` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:10.579631 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823973cc-dd86-42fd-bbba-b63783ea7e69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:10.580996 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823973cc-dd86-42fd-bbba-b63783ea7e69 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:10.586755 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 397/771] 10.222.0.83 () {56 vars in 1087 bytes} [Wed Jul 27 20:14:10 2022] GET /identity/v3/services => generated 1498 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 20:14:10.652023 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dc5f8-0229-49fb-92f9-dde7622e8b19 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:10.652311 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dc5f8-0229-49fb-92f9-dde7622e8b19 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:10.652590 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dc5f8-0229-49fb-92f9-dde7622e8b19 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:10.653943 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 375/772] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:14:10.659612 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0a759-be07-4bf8-bda0-f3de649988a3 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:10.659902 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0a759-be07-4bf8-bda0-f3de649988a3 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:10.660178 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0a759-be07-4bf8-bda0-f3de649988a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:10.679406 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-c3d0a759-be07-4bf8-bda0-f3de649988a3 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:14:10.680628 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-c3d0a759-be07-4bf8-bda0-f3de649988a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:14:10.743866 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:10.753311 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 398/773] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:14:10 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:14:10.776962 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734dc5f8-0229-49fb-92f9-dde7622e8b19 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:10.878093 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734dc5f8-0229-49fb-92f9-dde7622e8b19 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:10.911944 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1abaf-2f48-4b62-bdf5-c44455e065a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:10.912590 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1abaf-2f48-4b62-bdf5-c44455e065a0 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:10.912870 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1abaf-2f48-4b62-bdf5-c44455e065a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:10.913318 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1abaf-2f48-4b62-bdf5-c44455e065a0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:10.913769 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1abaf-2f48-4b62-bdf5-c44455e065a0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:10.915173 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1abaf-2f48-4b62-bdf5-c44455e065a0 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:10.924165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-e6d1abaf-2f48-4b62-bdf5-c44455e065a0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 20:14:10.924165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:10.924165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 20:14:10.924165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 20:14:10.924165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 20:14:10.924165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 20:14:10.924165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 20:14:10.924165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:14:10.924165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 20:14:10.924165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:10.924165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 20:14:10.924165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:10.924165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:10.924165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:14:10.924165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:14:10.924165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:14:10.924165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:14:10.925144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:14:10.925144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:14:10.925144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:14:10.925144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:14:10.925144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:14:10.925144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:14:10.925144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 20:14:10.925144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 20:14:10.925144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 20:14:10.925144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 20:14:10.925144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:14:10.925144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:14:10.925144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:14:10.925144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:14:10.925144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:14:10.925144 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:14:10.926507 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:14:10.926507 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:14:10.926507 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:14:10.926507 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:14:10.926507 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:14:10.926507 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:14:10.926507 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:14:10.926507 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:14:10.926507 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:14:10.926507 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:14:10.926507 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 20:14:10.926507 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:14:10.926507 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 20:14:10.926507 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:10.926507 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 376/774] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 27 20:14:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:14:10.932461 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0a759-be07-4bf8-bda0-f3de649988a3 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:11.029182 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0a759-be07-4bf8-bda0-f3de649988a3 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:11.062538 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843d647-2fe0-4b64-9c76-f23e8349f391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:11.063185 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843d647-2fe0-4b64-9c76-f23e8349f391 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:11.063464 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843d647-2fe0-4b64-9c76-f23e8349f391 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:11.063737 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843d647-2fe0-4b64-9c76-f23e8349f391 None admin] PATH_INFO: `/v3/services` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:11.064412 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843d647-2fe0-4b64-9c76-f23e8349f391 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:11.064714 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843d647-2fe0-4b64-9c76-f23e8349f391 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:11.066094 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843d647-2fe0-4b64-9c76-f23e8349f391 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:11.070811 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 399/775] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 27 20:14:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:14:11.076481 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1abaf-2f48-4b62-bdf5-c44455e065a0 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:11.092734 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:11.178032 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1abaf-2f48-4b62-bdf5-c44455e065a0 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:11.210690 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4a92e-d8e9-4a0b-9c6d-54ff076c6f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:11.211336 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4a92e-d8e9-4a0b-9c6d-54ff076c6f9f None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:11.211614 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4a92e-d8e9-4a0b-9c6d-54ff076c6f9f None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:11.211883 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4a92e-d8e9-4a0b-9c6d-54ff076c6f9f None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:11.212558 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4a92e-d8e9-4a0b-9c6d-54ff076c6f9f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:11.212859 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4a92e-d8e9-4a0b-9c6d-54ff076c6f9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:11.214210 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4a92e-d8e9-4a0b-9c6d-54ff076c6f9f None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:11.218872 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 377/776] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 27 20:14:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:14:11.225448 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843d647-2fe0-4b64-9c76-f23e8349f391 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:11.282600 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:11.325378 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843d647-2fe0-4b64-9c76-f23e8349f391 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:11.359056 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ceb547-b26f-462d-a79e-e15615f836b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:11.359698 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ceb547-b26f-462d-a79e-e15615f836b2 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:11.359979 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ceb547-b26f-462d-a79e-e15615f836b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:11.360251 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ceb547-b26f-462d-a79e-e15615f836b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:11.360992 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ceb547-b26f-462d-a79e-e15615f836b2 None admin] RBAC: Adding query filter params (interface=public, service_id=75530801d0b441ada9bf33f34728b3c1, region_id=RegionOne) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:11.361361 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ceb547-b26f-462d-a79e-e15615f836b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:11.362723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ceb547-b26f-462d-a79e-e15615f836b2 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:11.367677 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 400/777] 10.222.0.83 () {56 vars in 1251 bytes} [Wed Jul 27 20:14:11 2022] GET /identity/v3/endpoints?service_id=75530801d0b441ada9bf33f34728b3c1&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:14:11.373157 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4a92e-d8e9-4a0b-9c6d-54ff076c6f9f None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:11.451140 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:11.472168 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4a92e-d8e9-4a0b-9c6d-54ff076c6f9f None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:11.503783 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a994c-b8e6-4248-bf74-cfb86612f6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:11.504883 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a994c-b8e6-4248-bf74-cfb86612f6e9 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:11.505161 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a994c-b8e6-4248-bf74-cfb86612f6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:11.505431 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a994c-b8e6-4248-bf74-cfb86612f6e9 None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:11.506071 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a994c-b8e6-4248-bf74-cfb86612f6e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:11.507456 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a994c-b8e6-4248-bf74-cfb86612f6e9 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:11.513607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 378/778] 10.222.0.83 () {56 vars in 1087 bytes} [Wed Jul 27 20:14:11 2022] GET /identity/v3/services => generated 1498 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 20:14:12.875826 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7f1cb-6d88-4841-b6b4-3f68e56eee8b None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:12.876351 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7f1cb-6d88-4841-b6b4-3f68e56eee8b None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:12.876351 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7f1cb-6d88-4841-b6b4-3f68e56eee8b None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:12.877833 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 401/779] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:14:12.883523 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197de50-d3d9-4a8b-9bee-e7089f926910 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:12.883897 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197de50-d3d9-4a8b-9bee-e7089f926910 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:12.884076 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197de50-d3d9-4a8b-9bee-e7089f926910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:12.901488 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-0197de50-d3d9-4a8b-9bee-e7089f926910 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:14:12.902661 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-0197de50-d3d9-4a8b-9bee-e7089f926910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:14:12.967205 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 379/780] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:14:12 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:14:12.993775 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7f1cb-6d88-4841-b6b4-3f68e56eee8b None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:13.098309 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7f1cb-6d88-4841-b6b4-3f68e56eee8b None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:13.121121 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:13.132082 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c0385-d1ff-4785-8787-462405a2aa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:13.132656 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c0385-d1ff-4785-8787-462405a2aa4e None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:13.132935 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c0385-d1ff-4785-8787-462405a2aa4e None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:13.133207 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c0385-d1ff-4785-8787-462405a2aa4e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:13.133821 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c0385-d1ff-4785-8787-462405a2aa4e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:13.135216 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c0385-d1ff-4785-8787-462405a2aa4e None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:13.143782 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-4d7c0385-d1ff-4785-8787-462405a2aa4e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 20:14:13.143782 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:13.143782 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 20:14:13.143782 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 20:14:13.143782 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 20:14:13.143782 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 20:14:13.143782 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 20:14:13.143782 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:14:13.143782 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 20:14:13.143782 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:14:13.143782 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 20:14:13.143782 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:14:13.143782 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:13.143782 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:14:13.143782 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:14:13.143782 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:14:13.144917 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:14:13.144917 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:14:13.144917 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:14:13.144917 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:14:13.144917 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:14:13.144917 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:14:13.144917 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:14:13.144917 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 20:14:13.144917 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 20:14:13.144917 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 20:14:13.144917 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 20:14:13.144917 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:14:13.144917 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:14:13.144917 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:14:13.144917 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:14:13.144917 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:14:13.146085 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:14:13.146085 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:14:13.146085 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:14:13.146085 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:14:13.146085 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:14:13.146085 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:14:13.146085 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:14:13.146085 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:14:13.146085 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:14:13.146085 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:14:13.146085 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:14:13.146085 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 20:14:13.146085 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:14:13.146085 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 20:14:13.146085 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:14:13.147439 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 402/781] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Jul 27 20:14:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:14:13.150862 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197de50-d3d9-4a8b-9bee-e7089f926910 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:13.217645 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:13.247720 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197de50-d3d9-4a8b-9bee-e7089f926910 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:13.280210 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc459891-8d5b-447b-9cf9-3f3fe61041f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:13.280835 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc459891-8d5b-447b-9cf9-3f3fe61041f5 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:13.281112 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc459891-8d5b-447b-9cf9-3f3fe61041f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:13.281381 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc459891-8d5b-447b-9cf9-3f3fe61041f5 None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:13.282050 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc459891-8d5b-447b-9cf9-3f3fe61041f5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:13.282350 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc459891-8d5b-447b-9cf9-3f3fe61041f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:13.283740 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc459891-8d5b-447b-9cf9-3f3fe61041f5 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:13.288824 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 380/782] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Jul 27 20:14:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:14:13.294494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c0385-d1ff-4785-8787-462405a2aa4e None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:13.391354 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c0385-d1ff-4785-8787-462405a2aa4e None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:13.423583 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bb846-72ce-4adc-aa29-30d85f9a4bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:13.424189 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bb846-72ce-4adc-aa29-30d85f9a4bc3 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:13.424465 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bb846-72ce-4adc-aa29-30d85f9a4bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:13.424734 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bb846-72ce-4adc-aa29-30d85f9a4bc3 None admin] PATH_INFO: `/v3/services` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:13.425389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bb846-72ce-4adc-aa29-30d85f9a4bc3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:13.425734 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bb846-72ce-4adc-aa29-30d85f9a4bc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:13.427113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bb846-72ce-4adc-aa29-30d85f9a4bc3 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:13.431915 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 403/783] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Jul 27 20:14:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:14:13.437384 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc459891-8d5b-447b-9cf9-3f3fe61041f5 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:13.533968 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc459891-8d5b-447b-9cf9-3f3fe61041f5 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:13.566711 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2474c67-1a39-4f08-8ab9-8d26eabc0319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:13.567388 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2474c67-1a39-4f08-8ab9-8d26eabc0319 None admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:13.567668 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2474c67-1a39-4f08-8ab9-8d26eabc0319 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:13.567939 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2474c67-1a39-4f08-8ab9-8d26eabc0319 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:13.568661 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2474c67-1a39-4f08-8ab9-8d26eabc0319 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:13.570061 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2474c67-1a39-4f08-8ab9-8d26eabc0319 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:13.576070 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:13.592434 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 381/784] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Jul 27 20:14:13 2022] POST /identity/v3/endpoints => generated 347 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:14:13.733348 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f25d7-4b60-4b3d-b0b4-7b76ba1264f4 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:13.733631 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f25d7-4b60-4b3d-b0b4-7b76ba1264f4 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:13.733904 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f25d7-4b60-4b3d-b0b4-7b76ba1264f4 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:13.735458 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 404/785] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:14:13.741031 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4320ae8-a73c-4279-a5a1-5c82dfca5e27 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:13.741324 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4320ae8-a73c-4279-a5a1-5c82dfca5e27 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:13.741602 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4320ae8-a73c-4279-a5a1-5c82dfca5e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:13.761685 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-f4320ae8-a73c-4279-a5a1-5c82dfca5e27 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:14:13.762888 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-f4320ae8-a73c-4279-a5a1-5c82dfca5e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:14:13.835926 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 382/786] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:14:13 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:14:13.859235 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f25d7-4b60-4b3d-b0b4-7b76ba1264f4 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:13.912053 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:13.960801 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f25d7-4b60-4b3d-b0b4-7b76ba1264f4 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:13.993360 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab9ec9-e7cd-4b86-8e73-e124744b9894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:13.993930 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab9ec9-e7cd-4b86-8e73-e124744b9894 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:13.994212 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab9ec9-e7cd-4b86-8e73-e124744b9894 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:13.994484 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab9ec9-e7cd-4b86-8e73-e124744b9894 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:13.995129 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab9ec9-e7cd-4b86-8e73-e124744b9894 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:13.996492 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab9ec9-e7cd-4b86-8e73-e124744b9894 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:14.005981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-d9ab9ec9-e7cd-4b86-8e73-e124744b9894 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 20:14:14.005981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:14.005981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 20:14:14.005981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 20:14:14.005981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 20:14:14.005981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 20:14:14.005981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 20:14:14.005981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:14:14.005981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 20:14:14.005981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:14:14.005981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 20:14:14.005981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:14:14.005981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:14.005981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:14:14.005981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:14:14.005981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:14:14.005981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:14:14.007194 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:14:14.007194 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:14:14.007194 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:14:14.007194 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:14:14.007194 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:14:14.007194 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:14:14.007194 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 20:14:14.007194 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 20:14:14.007194 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 20:14:14.007194 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 20:14:14.007194 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:14:14.007194 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:14:14.007194 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:14:14.007194 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:14:14.007194 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:14:14.007194 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:14:14.008057 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:14:14.008057 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:14:14.008057 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:14:14.008057 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:14:14.008057 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:14:14.008057 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:14:14.008057 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:14:14.008057 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:14:14.008057 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:14:14.008057 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:14:14.008057 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 20:14:14.008057 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:14:14.008057 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 20:14:14.008057 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:14:14.008057 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 405/787] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 27 20:14:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:14:14.013189 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4320ae8-a73c-4279-a5a1-5c82dfca5e27 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:14.111392 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4320ae8-a73c-4279-a5a1-5c82dfca5e27 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:14.129313 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:14.146437 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b258459-68f4-4d8b-b517-91adf36113f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:14.147059 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b258459-68f4-4d8b-b517-91adf36113f0 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:14.147380 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b258459-68f4-4d8b-b517-91adf36113f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:14.147955 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b258459-68f4-4d8b-b517-91adf36113f0 None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:14.148634 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b258459-68f4-4d8b-b517-91adf36113f0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:14.148939 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b258459-68f4-4d8b-b517-91adf36113f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:14.150298 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b258459-68f4-4d8b-b517-91adf36113f0 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:14.154868 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 383/788] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 27 20:14:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:14:14.160596 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab9ec9-e7cd-4b86-8e73-e124744b9894 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:14.257221 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab9ec9-e7cd-4b86-8e73-e124744b9894 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:14.273055 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:14.290358 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aed5c4-9c3d-4225-8911-7a18cab895f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:14.290963 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aed5c4-9c3d-4225-8911-7a18cab895f4 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:14.291267 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aed5c4-9c3d-4225-8911-7a18cab895f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:14.291539 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aed5c4-9c3d-4225-8911-7a18cab895f4 None admin] PATH_INFO: `/v3/services` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:14.292195 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aed5c4-9c3d-4225-8911-7a18cab895f4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:14.292496 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aed5c4-9c3d-4225-8911-7a18cab895f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:14.293851 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aed5c4-9c3d-4225-8911-7a18cab895f4 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:14.301308 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 406/789] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 27 20:14:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:14:14.304703 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b258459-68f4-4d8b-b517-91adf36113f0 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:14.404104 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b258459-68f4-4d8b-b517-91adf36113f0 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:14.440240 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4dbae-7a0a-4b66-a9f1-a017587b956d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:14.440861 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4dbae-7a0a-4b66-a9f1-a017587b956d None admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:14.441162 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4dbae-7a0a-4b66-a9f1-a017587b956d None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:14.442082 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4dbae-7a0a-4b66-a9f1-a017587b956d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:14.443414 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4dbae-7a0a-4b66-a9f1-a017587b956d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:14.445242 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4dbae-7a0a-4b66-a9f1-a017587b956d None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:14.465558 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 384/790] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Jul 27 20:14:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:14:15.830428 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfad5b-25a5-44de-b7c6-f0b6d93a09a9 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:15.831022 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfad5b-25a5-44de-b7c6-f0b6d93a09a9 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:15.831022 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfad5b-25a5-44de-b7c6-f0b6d93a09a9 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:15.832913 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 407/791] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:14:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:14:15.838071 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9f6f0-6bba-49e3-80d1-2a0a3b2a987d None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:15.838477 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9f6f0-6bba-49e3-80d1-2a0a3b2a987d None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:15.838615 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9f6f0-6bba-49e3-80d1-2a0a3b2a987d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:15.856845 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-78b9f6f0-6bba-49e3-80d1-2a0a3b2a987d None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:14:15.858014 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-78b9f6f0-6bba-49e3-80d1-2a0a3b2a987d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:14:15.886533 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:15.930146 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 385/792] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:14:15 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:14:15.953402 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cfad5b-25a5-44de-b7c6-f0b6d93a09a9 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:16.052567 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cfad5b-25a5-44de-b7c6-f0b6d93a09a9 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:16.086261 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842639bb-f9a7-46fa-a5e9-4ec3a1ee5af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:16.086832 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842639bb-f9a7-46fa-a5e9-4ec3a1ee5af4 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:16.087256 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842639bb-f9a7-46fa-a5e9-4ec3a1ee5af4 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:16.087431 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842639bb-f9a7-46fa-a5e9-4ec3a1ee5af4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:16.088055 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842639bb-f9a7-46fa-a5e9-4ec3a1ee5af4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:16.089415 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842639bb-f9a7-46fa-a5e9-4ec3a1ee5af4 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:16.098109 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-842639bb-f9a7-46fa-a5e9-4ec3a1ee5af4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 20:14:16.098109 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:16.098109 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 20:14:16.098109 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 20:14:16.098109 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 20:14:16.098109 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 20:14:16.098109 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 20:14:16.098109 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:14:16.098109 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 20:14:16.098109 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:14:16.098109 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 20:14:16.098109 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:14:16.098109 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:16.098109 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:14:16.098109 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:14:16.098109 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:14:16.098109 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:14:16.099389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:14:16.099389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:14:16.099389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:14:16.099389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:14:16.099389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:14:16.099389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:14:16.099389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 20:14:16.099389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 20:14:16.099389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 20:14:16.099389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 20:14:16.099389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:14:16.099389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:14:16.099389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:14:16.099389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:14:16.099389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:14:16.099389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:14:16.100320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:14:16.100320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:14:16.100320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:14:16.100320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:14:16.100320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:14:16.100320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:14:16.100320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:14:16.100320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:14:16.100320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:14:16.100320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:14:16.100320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 20:14:16.100320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:14:16.100320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 20:14:16.100320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:14:16.100320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 408/793] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:14:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:14:16.105204 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9f6f0-6bba-49e3-80d1-2a0a3b2a987d None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:16.202659 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9f6f0-6bba-49e3-80d1-2a0a3b2a987d None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:16.236249 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3390eda-1c72-4577-84d1-c3b90a301ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:16.236868 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3390eda-1c72-4577-84d1-c3b90a301ab4 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:16.237150 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3390eda-1c72-4577-84d1-c3b90a301ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:16.237423 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3390eda-1c72-4577-84d1-c3b90a301ab4 None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:16.238130 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3390eda-1c72-4577-84d1-c3b90a301ab4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:16.238435 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3390eda-1c72-4577-84d1-c3b90a301ab4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:16.239824 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3390eda-1c72-4577-84d1-c3b90a301ab4 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:16.244671 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 386/794] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Jul 27 20:14:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:14:16.250433 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842639bb-f9a7-46fa-a5e9-4ec3a1ee5af4 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:16.295870 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:16.352745 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842639bb-f9a7-46fa-a5e9-4ec3a1ee5af4 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:16.385581 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e46b2-d845-4270-b25b-9c6395b3a5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:16.386185 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e46b2-d845-4270-b25b-9c6395b3a5b8 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:16.386461 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e46b2-d845-4270-b25b-9c6395b3a5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:16.386730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e46b2-d845-4270-b25b-9c6395b3a5b8 None admin] PATH_INFO: `/v3/services` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:16.387420 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e46b2-d845-4270-b25b-9c6395b3a5b8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:16.387720 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e46b2-d845-4270-b25b-9c6395b3a5b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:16.389070 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e46b2-d845-4270-b25b-9c6395b3a5b8 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:16.393354 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 409/795] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Jul 27 20:14:16 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:14:16.695362 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d415707-520a-4d2f-983f-57288b6f7d84 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:16.695565 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d415707-520a-4d2f-983f-57288b6f7d84 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:16.695825 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d415707-520a-4d2f-983f-57288b6f7d84 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:16.697148 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 387/796] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:14:16.702303 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a8d77-b3da-450b-a230-9f8e588be5e8 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:16.702584 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a8d77-b3da-450b-a230-9f8e588be5e8 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:16.702859 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a8d77-b3da-450b-a230-9f8e588be5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:16.720984 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-592a8d77-b3da-450b-a230-9f8e588be5e8 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:14:16.722138 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-592a8d77-b3da-450b-a230-9f8e588be5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:14:16.788882 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 410/797] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:14:16 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:14:16.813394 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d415707-520a-4d2f-983f-57288b6f7d84 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:16.841006 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:16.915289 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d415707-520a-4d2f-983f-57288b6f7d84 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:16.948602 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488580f2-96db-4953-8242-ac7fa8086cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:16.949155 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488580f2-96db-4953-8242-ac7fa8086cfc None admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:16.949436 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488580f2-96db-4953-8242-ac7fa8086cfc None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:16.949710 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488580f2-96db-4953-8242-ac7fa8086cfc None admin] PATH_INFO: `/v3/projects` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:16.950375 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488580f2-96db-4953-8242-ac7fa8086cfc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:16.951830 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488580f2-96db-4953-8242-ac7fa8086cfc None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:16.954420 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: WARNING keystone.server.flask.common [None req-488580f2-96db-4953-8242-ac7fa8086cfc None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 27 20:14:16.970966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.sql.core [None req-488580f2-96db-4953-8242-ac7fa8086cfc None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 20:14:16.970966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 20:14:16.970966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [parameters: {'id': '78a2d0b00504445abf9058fdccabf2c9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 20:14:16.970966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87127) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 20:14:16.988960 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-488580f2-96db-4953-8242-ac7fa8086cfc None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 78a2d0b00504445abf9058fdccabf2c9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 78a2d0b00504445abf9058fdccabf2c9. Jul 27 20:14:16.988960 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:16.988960 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 20:14:16.988960 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 20:14:16.988960 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 20:14:16.988960 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 20:14:16.988960 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 20:14:16.988960 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 20:14:16.988960 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 20:14:16.988960 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application conn.query(q) Jul 27 20:14:16.988960 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 20:14:16.988960 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 20:14:16.988960 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 20:14:16.989997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application result.read() Jul 27 20:14:16.989997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 20:14:16.989997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 20:14:16.989997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 20:14:16.989997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 20:14:16.989997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 20:14:16.989997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 20:14:16.989997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 20:14:16.989997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 20:14:16.989997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 20:14:16.989997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:16.989997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 20:14:16.989997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:16.989997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:16.989997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 20:14:16.989997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 20:14:16.989997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 27 20:14:16.989997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 27 20:14:16.991330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 20:14:16.991330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application next(self.gen) Jul 27 20:14:16.991330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 20:14:16.991330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application yield resource Jul 27 20:14:16.991330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 20:14:16.991330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application next(self.gen) Jul 27 20:14:16.991330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 20:14:16.991330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 20:14:16.991330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 20:14:16.991330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 20:14:16.991330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 20:14:16.991330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise self.value Jul 27 20:14:16.991330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 20:14:16.991330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 20:14:16.991330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 20:14:16.991330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application session.commit() Jul 27 20:14:16.991330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 20:14:16.992498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 20:14:16.992498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 20:14:16.992498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 20:14:16.992498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 20:14:16.992498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self.session.flush() Jul 27 20:14:16.992498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 20:14:16.992498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 20:14:16.992498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 20:14:16.992498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 20:14:16.992498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 20:14:16.992498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application compat.raise_( Jul 27 20:14:16.992498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 20:14:16.992498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception Jul 27 20:14:16.992498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 20:14:16.992498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 20:14:16.992498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 20:14:16.992498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 20:14:16.993654 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 20:14:16.993654 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 20:14:16.993654 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 20:14:16.993654 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 20:14:16.993654 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 20:14:16.993654 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 20:14:16.993654 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 20:14:16.993654 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 20:14:16.993654 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 20:14:16.993654 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 20:14:16.993654 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 20:14:16.993654 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 20:14:16.993654 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 20:14:16.993654 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 20:14:16.993654 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 20:14:16.994657 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 20:14:16.994657 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 20:14:16.994657 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception Jul 27 20:14:16.994657 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 20:14:16.994657 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 20:14:16.994657 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 20:14:16.994657 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 20:14:16.994657 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 20:14:16.994657 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 20:14:16.994657 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 20:14:16.994657 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application conn.query(q) Jul 27 20:14:16.994657 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 20:14:16.994657 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 20:14:16.994657 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 20:14:16.994657 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application result.read() Jul 27 20:14:16.994657 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 20:14:16.994657 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 20:14:16.996222 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 20:14:16.996222 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 20:14:16.996222 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 20:14:16.996222 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 20:14:16.996222 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 20:14:16.996222 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 20:14:16.996222 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 20:14:16.996222 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 20:14:16.996222 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [parameters: {'id': '78a2d0b00504445abf9058fdccabf2c9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 20:14:16.996222 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 20:14:16.996222 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:16.996222 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 20:14:16.996222 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:16.996222 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:16.996222 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 27 20:14:16.997028 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 27 20:14:16.997028 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 20:14:16.997028 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 20:14:16.997028 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 27 20:14:16.997028 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:16.997028 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 20:14:16.997028 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:16.997028 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:16.997028 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:14:16.997028 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:14:16.997028 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:14:16.997028 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:14:16.997028 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:14:16.997028 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:14:16.997028 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:14:16.997028 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:14:16.997028 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:14:16.997933 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:14:16.997933 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 27 20:14:16.997933 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 27 20:14:16.997933 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:14:16.997933 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:14:16.997933 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 27 20:14:16.997933 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 27 20:14:16.997933 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 78a2d0b00504445abf9058fdccabf2c9. Jul 27 20:14:16.997933 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:16.997933 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 388/798] 10.222.0.83 () {60 vars in 1140 bytes} [Wed Jul 27 20:14:16 2022] POST /identity/v3/projects => generated 262 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:14:16.998739 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a8d77-b3da-450b-a230-9f8e588be5e8 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:17.042433 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:17.116069 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a8d77-b3da-450b-a230-9f8e588be5e8 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:17.150602 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402ef94-e505-43ae-a1d1-a04959e3e9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:17.151191 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402ef94-e505-43ae-a1d1-a04959e3e9b8 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:17.151473 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402ef94-e505-43ae-a1d1-a04959e3e9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:17.151747 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402ef94-e505-43ae-a1d1-a04959e3e9b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:17.158461 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402ef94-e505-43ae-a1d1-a04959e3e9b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:17.160479 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402ef94-e505-43ae-a1d1-a04959e3e9b8 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:17.171549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-e402ef94-e505-43ae-a1d1-a04959e3e9b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:14:17.171549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:17.171549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:14:17.171549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:14:17.171549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:14:17.171549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:14:17.171549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:14:17.171549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:14:17.171549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:14:17.171549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:14:17.171549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:14:17.171549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:14:17.171549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 20:14:17.171549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 20:14:17.171549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 20:14:17.172616 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 20:14:17.172616 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:14:17.172616 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:14:17.172616 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:14:17.172616 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:14:17.172616 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:14:17.172616 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:14:17.172616 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:14:17.172616 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:14:17.172616 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:14:17.172616 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:14:17.172616 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:14:17.172616 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:14:17.172616 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:14:17.172616 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:14:17.172616 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:14:17.172616 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:14:17.173538 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 20:14:17.173538 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 20:14:17.173538 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 20:14:17.173538 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 20:14:17.173538 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 20:14:17.173538 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 20:14:17.173538 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:14:17.173538 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:14:17.173538 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 411/799] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:14:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:14:17.179086 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488580f2-96db-4953-8242-ac7fa8086cfc None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:17.266287 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:17.286504 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488580f2-96db-4953-8242-ac7fa8086cfc None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:17.322141 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d57cc-7470-4f66-865b-4a8a43c6c582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:17.322762 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d57cc-7470-4f66-865b-4a8a43c6c582 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:17.323042 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d57cc-7470-4f66-865b-4a8a43c6c582 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:17.323347 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d57cc-7470-4f66-865b-4a8a43c6c582 None admin] PATH_INFO: `/v3/projects` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:17.324090 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d57cc-7470-4f66-865b-4a8a43c6c582 None admin] RBAC: Adding query filter params (name=service) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:17.324394 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d57cc-7470-4f66-865b-4a8a43c6c582 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:17.326021 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d57cc-7470-4f66-865b-4a8a43c6c582 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:17.345691 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 389/800] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Jul 27 20:14:17 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:14:18.634610 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b522e-0aae-452b-8e1c-d4de03e167df None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:18.635152 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b522e-0aae-452b-8e1c-d4de03e167df None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:18.635152 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b522e-0aae-452b-8e1c-d4de03e167df None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:18.636424 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 412/801] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:14:18.641680 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f22ec-80b0-405e-8bc4-9797e27e4596 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:18.642078 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f22ec-80b0-405e-8bc4-9797e27e4596 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:18.642245 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f22ec-80b0-405e-8bc4-9797e27e4596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:18.660470 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-e06f22ec-80b0-405e-8bc4-9797e27e4596 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:14:18.661985 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-e06f22ec-80b0-405e-8bc4-9797e27e4596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:14:18.726322 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 390/802] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:14:18 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:14:18.749940 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b522e-0aae-452b-8e1c-d4de03e167df None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:18.843217 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:18.848705 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b522e-0aae-452b-8e1c-d4de03e167df None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:18.885024 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9a0f9-55bf-41a5-80e6-3e3632ec5e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:18.885571 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9a0f9-55bf-41a5-80e6-3e3632ec5e0f None admin] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:18.885848 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9a0f9-55bf-41a5-80e6-3e3632ec5e0f None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:18.886119 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9a0f9-55bf-41a5-80e6-3e3632ec5e0f None admin] PATH_INFO: `/v3/services` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:18.886804 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9a0f9-55bf-41a5-80e6-3e3632ec5e0f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:18.888215 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9a0f9-55bf-41a5-80e6-3e3632ec5e0f None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:18.903109 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 413/803] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Jul 27 20:14:18 2022] POST /identity/v3/services => generated 242 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:14:19.621340 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce46d1-de68-409e-a065-8984a787e0b2 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:19.621555 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce46d1-de68-409e-a065-8984a787e0b2 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:19.621828 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce46d1-de68-409e-a065-8984a787e0b2 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:19.623206 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 391/804] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:14:19.628906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e36df-9f79-46ff-8c37-f7001fe61466 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:19.629267 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e36df-9f79-46ff-8c37-f7001fe61466 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:19.629553 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e36df-9f79-46ff-8c37-f7001fe61466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:19.647686 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-5c9e36df-9f79-46ff-8c37-f7001fe61466 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:14:19.648863 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-5c9e36df-9f79-46ff-8c37-f7001fe61466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:14:19.718376 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 414/805] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:14:19 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:14:19.743639 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce46d1-de68-409e-a065-8984a787e0b2 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:19.817798 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:19.843815 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce46d1-de68-409e-a065-8984a787e0b2 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:19.876001 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93b6ae-d5f3-43e0-b5bc-1356bde16956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:19.876523 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93b6ae-d5f3-43e0-b5bc-1356bde16956 None admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:19.876801 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93b6ae-d5f3-43e0-b5bc-1356bde16956 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:19.877072 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93b6ae-d5f3-43e0-b5bc-1356bde16956 None admin] PATH_INFO: `/v3/users` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:19.877741 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93b6ae-d5f3-43e0-b5bc-1356bde16956 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:19.879688 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93b6ae-d5f3-43e0-b5bc-1356bde16956 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:19.893596 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.sql.core [None req-4c93b6ae-d5f3-43e0-b5bc-1356bde16956 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 20:14:19.893596 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 20:14:19.893596 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [parameters: {'user_id': '7ac36887369a4d9689115109b4918d86', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 20:14:19.893596 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87127) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 20:14:19.901460 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-4c93b6ae-d5f3-43e0-b5bc-1356bde16956 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 20:14:19.901460 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:19.901460 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 20:14:19.901460 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 20:14:19.901460 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 20:14:19.901460 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 20:14:19.901460 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 20:14:19.901460 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 20:14:19.901460 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 20:14:19.901460 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application conn.query(q) Jul 27 20:14:19.901460 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 20:14:19.901460 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 20:14:19.901460 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 20:14:19.901460 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application result.read() Jul 27 20:14:19.901460 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 20:14:19.902525 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 20:14:19.902525 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 20:14:19.902525 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 20:14:19.902525 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 20:14:19.902525 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 20:14:19.902525 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 20:14:19.902525 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 20:14:19.902525 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 20:14:19.902525 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:19.902525 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 20:14:19.902525 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:19.902525 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:19.902525 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 20:14:19.902525 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 20:14:19.902525 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 27 20:14:19.902525 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 27 20:14:19.902525 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 20:14:19.902525 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application next(self.gen) Jul 27 20:14:19.903607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 20:14:19.903607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application yield resource Jul 27 20:14:19.903607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 20:14:19.903607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application next(self.gen) Jul 27 20:14:19.903607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 20:14:19.903607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 20:14:19.903607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 20:14:19.903607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 20:14:19.903607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 20:14:19.903607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise self.value Jul 27 20:14:19.903607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 20:14:19.903607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 20:14:19.903607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 20:14:19.903607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application session.commit() Jul 27 20:14:19.903607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 20:14:19.903607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 20:14:19.903607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 20:14:19.904981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 20:14:19.904981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 20:14:19.904981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self.session.flush() Jul 27 20:14:19.904981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 20:14:19.904981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 20:14:19.904981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 20:14:19.904981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 20:14:19.904981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 20:14:19.904981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application compat.raise_( Jul 27 20:14:19.904981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 20:14:19.904981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception Jul 27 20:14:19.904981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 20:14:19.904981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 20:14:19.904981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 20:14:19.904981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 20:14:19.904981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 20:14:19.904981 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 20:14:19.906068 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 20:14:19.906068 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 20:14:19.906068 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 27 20:14:19.906068 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 27 20:14:19.906068 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 20:14:19.906068 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 20:14:19.906068 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 20:14:19.906068 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 20:14:19.906068 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 20:14:19.906068 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 20:14:19.906068 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 20:14:19.906068 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 20:14:19.906068 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 20:14:19.906068 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 20:14:19.906068 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 20:14:19.906068 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception Jul 27 20:14:19.907323 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 20:14:19.907323 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 20:14:19.907323 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 20:14:19.907323 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 20:14:19.907323 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 20:14:19.907323 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 20:14:19.907323 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 20:14:19.907323 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application conn.query(q) Jul 27 20:14:19.907323 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 20:14:19.907323 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 20:14:19.907323 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 20:14:19.907323 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application result.read() Jul 27 20:14:19.907323 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 20:14:19.907323 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 20:14:19.907323 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 20:14:19.907323 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 20:14:19.908514 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 20:14:19.908514 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 20:14:19.908514 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 20:14:19.908514 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 20:14:19.908514 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 20:14:19.908514 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 20:14:19.908514 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [parameters: {'user_id': '7ac36887369a4d9689115109b4918d86', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 20:14:19.908514 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 20:14:19.908514 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:19.908514 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 20:14:19.908514 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:19.908514 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:19.908514 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:14:19.908514 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:14:19.908514 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:14:19.909459 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:14:19.909459 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:14:19.909459 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:14:19.909459 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:14:19.909459 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:14:19.909459 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:14:19.909459 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:14:19.909459 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 27 20:14:19.909459 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 27 20:14:19.909459 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:14:19.909459 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:14:19.909459 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 20:14:19.909459 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:14:19.909459 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 20:14:19.909459 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:14:19.909459 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 27 20:14:19.909459 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 27 20:14:19.910700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 27 20:14:19.910700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 27 20:14:19.910700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 20:14:19.910700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 20:14:19.910700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 20:14:19.910700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:19.910700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 392/806] 10.222.0.83 () {60 vars in 1131 bytes} [Wed Jul 27 20:14:19 2022] POST /identity/v3/users => generated 160 bytes in 164 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:14:19.911213 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e36df-9f79-46ff-8c37-f7001fe61466 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:19.991952 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:20.009451 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e36df-9f79-46ff-8c37-f7001fe61466 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:20.042722 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b626c9a-3312-4e44-9986-89b05b92374c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:20.043411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b626c9a-3312-4e44-9986-89b05b92374c None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:20.043691 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b626c9a-3312-4e44-9986-89b05b92374c None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:20.043963 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b626c9a-3312-4e44-9986-89b05b92374c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:20.052403 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b626c9a-3312-4e44-9986-89b05b92374c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:20.053872 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b626c9a-3312-4e44-9986-89b05b92374c None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:20.070608 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-9b626c9a-3312-4e44-9986-89b05b92374c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 20:14:20.070608 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:20.070608 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:14:20.070608 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:14:20.070608 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:14:20.070608 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:14:20.070608 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:14:20.070608 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:14:20.070608 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:14:20.070608 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:14:20.070608 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:14:20.070608 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:14:20.070608 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 20:14:20.070608 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 20:14:20.070608 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 20:14:20.070608 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 20:14:20.071817 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:14:20.071817 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:14:20.071817 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 20:14:20.071817 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:14:20.071817 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 20:14:20.071817 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:14:20.071817 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:14:20.071817 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:14:20.071817 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:14:20.071817 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:14:20.071817 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:14:20.071817 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:14:20.071817 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:14:20.071817 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:14:20.071817 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:14:20.071817 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:14:20.071817 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:14:20.071817 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:14:20.072883 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:14:20.072883 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:14:20.072883 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 20:14:20.072883 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 20:14:20.072883 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 20:14:20.072883 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 20:14:20.072883 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 20:14:20.072883 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 20:14:20.072883 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 20:14:20.072883 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:14:20.072883 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 415/807] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:14:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:14:20.074184 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93b6ae-d5f3-43e0-b5bc-1356bde16956 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:20.173325 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93b6ae-d5f3-43e0-b5bc-1356bde16956 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:20.206254 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980dbd8f-2dfb-4615-98a6-6b1029aef282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:20.206865 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dbd8f-2dfb-4615-98a6-6b1029aef282 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:20.207171 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dbd8f-2dfb-4615-98a6-6b1029aef282 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:20.207441 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dbd8f-2dfb-4615-98a6-6b1029aef282 None admin] PATH_INFO: `/v3/users` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:20.208189 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980dbd8f-2dfb-4615-98a6-6b1029aef282 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:20.208488 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980dbd8f-2dfb-4615-98a6-6b1029aef282 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:20.210091 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980dbd8f-2dfb-4615-98a6-6b1029aef282 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:20.219942 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:20.247293 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 393/808] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 27 20:14:20 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:14:21.144253 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9813f-a31e-49a2-a006-7ba775e403b4 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:21.144783 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9813f-a31e-49a2-a006-7ba775e403b4 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:21.144783 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9813f-a31e-49a2-a006-7ba775e403b4 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:21.146105 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 416/809] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:14:21.151236 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993c05c-0c4c-4f53-a909-514ce8641428 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:21.151640 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993c05c-0c4c-4f53-a909-514ce8641428 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:21.151786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993c05c-0c4c-4f53-a909-514ce8641428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:21.169633 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-1993c05c-0c4c-4f53-a909-514ce8641428 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:14:21.171147 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-1993c05c-0c4c-4f53-a909-514ce8641428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:14:21.235239 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 394/810] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:14:21 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:14:21.259732 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9813f-a31e-49a2-a006-7ba775e403b4 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:21.358513 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9813f-a31e-49a2-a006-7ba775e403b4 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:21.394461 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38afbbc-0bc2-481c-954a-7838423eaa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:21.395023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38afbbc-0bc2-481c-954a-7838423eaa5f None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:21.395334 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38afbbc-0bc2-481c-954a-7838423eaa5f None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:21.395608 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38afbbc-0bc2-481c-954a-7838423eaa5f None admin] PATH_INFO: `/v3/services/compute` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:21.396221 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38afbbc-0bc2-481c-954a-7838423eaa5f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:21.397589 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38afbbc-0bc2-481c-954a-7838423eaa5f None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:21.406510 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-f38afbbc-0bc2-481c-954a-7838423eaa5f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 20:14:21.406510 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:21.406510 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 20:14:21.406510 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 20:14:21.406510 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 20:14:21.406510 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 20:14:21.406510 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 20:14:21.406510 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:14:21.406510 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 20:14:21.406510 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:14:21.406510 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 20:14:21.406510 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:14:21.406510 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:21.406510 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:14:21.406510 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:14:21.406510 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:14:21.406510 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:14:21.407664 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:14:21.407664 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:14:21.407664 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:14:21.407664 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:14:21.407664 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:14:21.407664 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:14:21.407664 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 20:14:21.407664 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 20:14:21.407664 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 20:14:21.407664 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 20:14:21.407664 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:14:21.407664 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:14:21.407664 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:14:21.407664 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:14:21.407664 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:14:21.407664 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:14:21.408715 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:14:21.408715 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:14:21.408715 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:14:21.408715 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:14:21.408715 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:14:21.408715 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:14:21.408715 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:14:21.408715 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:14:21.408715 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:14:21.408715 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:14:21.408715 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 20:14:21.408715 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:14:21.408715 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 20:14:21.408715 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:14:21.408715 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 417/811] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:14:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:14:21.414032 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993c05c-0c4c-4f53-a909-514ce8641428 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:21.507133 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993c05c-0c4c-4f53-a909-514ce8641428 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:21.528829 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:21.539728 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbec7d-3bf9-48a0-905b-8269ea14b5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:21.540331 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbec7d-3bf9-48a0-905b-8269ea14b5b9 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:21.540604 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbec7d-3bf9-48a0-905b-8269ea14b5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:21.540871 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbec7d-3bf9-48a0-905b-8269ea14b5b9 None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:21.541537 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbec7d-3bf9-48a0-905b-8269ea14b5b9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:21.541835 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbec7d-3bf9-48a0-905b-8269ea14b5b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:21.543227 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbec7d-3bf9-48a0-905b-8269ea14b5b9 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:21.547822 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 395/812] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Jul 27 20:14:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:14:21.553924 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38afbbc-0bc2-481c-954a-7838423eaa5f None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:21.564854 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:21.656855 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38afbbc-0bc2-481c-954a-7838423eaa5f None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:21.689542 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50685df4-6652-4e0d-bf7b-262d9f882aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:21.690154 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50685df4-6652-4e0d-bf7b-262d9f882aa3 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:21.690432 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50685df4-6652-4e0d-bf7b-262d9f882aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:21.690704 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50685df4-6652-4e0d-bf7b-262d9f882aa3 None admin] PATH_INFO: `/v3/services` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:21.691402 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50685df4-6652-4e0d-bf7b-262d9f882aa3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:21.691705 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50685df4-6652-4e0d-bf7b-262d9f882aa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:21.693082 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50685df4-6652-4e0d-bf7b-262d9f882aa3 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:21.697802 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 418/813] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Jul 27 20:14:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:14:21.703719 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbec7d-3bf9-48a0-905b-8269ea14b5b9 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:21.800310 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbec7d-3bf9-48a0-905b-8269ea14b5b9 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:21.832289 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad9ec5-a573-424d-a72a-77a2be241553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:21.832890 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad9ec5-a573-424d-a72a-77a2be241553 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:21.833167 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad9ec5-a573-424d-a72a-77a2be241553 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:21.833437 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad9ec5-a573-424d-a72a-77a2be241553 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:21.834171 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad9ec5-a573-424d-a72a-77a2be241553 None admin] RBAC: Adding query filter params (interface=public, service_id=d881c73f493e465ea39642836b169426, region_id=RegionOne) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:21.834478 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad9ec5-a573-424d-a72a-77a2be241553 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:21.835871 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad9ec5-a573-424d-a72a-77a2be241553 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:21.840882 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 396/814] 10.222.0.83 () {56 vars in 1251 bytes} [Wed Jul 27 20:14:21 2022] GET /identity/v3/endpoints?service_id=d881c73f493e465ea39642836b169426&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:14:21.846274 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50685df4-6652-4e0d-bf7b-262d9f882aa3 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:21.914666 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:21.945576 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50685df4-6652-4e0d-bf7b-262d9f882aa3 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:21.982209 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4cc739-cf5a-4c5a-b17e-707ec5d46e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:21.982817 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cc739-cf5a-4c5a-b17e-707ec5d46e46 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:21.983119 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cc739-cf5a-4c5a-b17e-707ec5d46e46 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:21.983400 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cc739-cf5a-4c5a-b17e-707ec5d46e46 None admin] PATH_INFO: `/v3/services` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:21.984044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4cc739-cf5a-4c5a-b17e-707ec5d46e46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:21.985411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4cc739-cf5a-4c5a-b17e-707ec5d46e46 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:21.991411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 419/815] 10.222.0.83 () {56 vars in 1087 bytes} [Wed Jul 27 20:14:21 2022] GET /identity/v3/services => generated 1728 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 20:14:24.205316 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d64fc9-96dd-4005-93f6-238aedec8896 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:24.205847 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d64fc9-96dd-4005-93f6-238aedec8896 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:24.205847 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d64fc9-96dd-4005-93f6-238aedec8896 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:24.207239 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 397/816] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:14:24.212235 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627104d-bd67-4b47-b776-d1db8607631d None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:24.212604 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627104d-bd67-4b47-b776-d1db8607631d None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:24.212788 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627104d-bd67-4b47-b776-d1db8607631d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:24.230937 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-0627104d-bd67-4b47-b776-d1db8607631d None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:14:24.232148 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-0627104d-bd67-4b47-b776-d1db8607631d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:14:24.296107 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 420/817] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:14:24 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:14:24.320814 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d64fc9-96dd-4005-93f6-238aedec8896 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:24.374138 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:24.421223 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d64fc9-96dd-4005-93f6-238aedec8896 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:24.455585 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916f217-c0b5-4457-9e9c-b143e500ef1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:24.456189 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916f217-c0b5-4457-9e9c-b143e500ef1b None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:24.456470 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916f217-c0b5-4457-9e9c-b143e500ef1b None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:24.456740 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916f217-c0b5-4457-9e9c-b143e500ef1b None admin] PATH_INFO: `/v3/services/compute` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:24.457356 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916f217-c0b5-4457-9e9c-b143e500ef1b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:24.458703 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916f217-c0b5-4457-9e9c-b143e500ef1b None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:24.467809 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-c916f217-c0b5-4457-9e9c-b143e500ef1b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 20:14:24.467809 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:24.467809 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 20:14:24.467809 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 20:14:24.467809 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 20:14:24.467809 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 20:14:24.467809 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 20:14:24.467809 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:14:24.467809 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 20:14:24.467809 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:24.467809 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 20:14:24.467809 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:24.467809 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:14:24.467809 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:14:24.467809 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:14:24.467809 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:14:24.467809 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:14:24.468949 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:14:24.468949 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:14:24.468949 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:14:24.468949 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:14:24.468949 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:14:24.468949 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:14:24.468949 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 20:14:24.468949 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 20:14:24.468949 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 20:14:24.468949 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 20:14:24.468949 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:14:24.468949 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:14:24.468949 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:14:24.468949 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:14:24.468949 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:14:24.468949 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:14:24.470002 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:14:24.470002 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:14:24.470002 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:14:24.470002 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:14:24.470002 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:14:24.470002 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:14:24.470002 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:14:24.470002 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:14:24.470002 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:14:24.470002 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:14:24.470002 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 20:14:24.470002 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:14:24.470002 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 20:14:24.470002 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:14:24.470002 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 398/818] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:14:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:14:24.475582 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627104d-bd67-4b47-b776-d1db8607631d None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:24.542123 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:24.576306 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627104d-bd67-4b47-b776-d1db8607631d None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:24.609258 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841f965-eab0-4c0e-a9f1-f9ea7e5af899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:24.609862 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841f965-eab0-4c0e-a9f1-f9ea7e5af899 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:24.610138 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841f965-eab0-4c0e-a9f1-f9ea7e5af899 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:24.610410 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841f965-eab0-4c0e-a9f1-f9ea7e5af899 None admin] PATH_INFO: `/v3/services` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:24.611099 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841f965-eab0-4c0e-a9f1-f9ea7e5af899 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:24.611393 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841f965-eab0-4c0e-a9f1-f9ea7e5af899 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:24.612766 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841f965-eab0-4c0e-a9f1-f9ea7e5af899 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:24.617292 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 421/819] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Jul 27 20:14:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:14:24.623316 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916f217-c0b5-4457-9e9c-b143e500ef1b None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:24.726135 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916f217-c0b5-4457-9e9c-b143e500ef1b None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:24.741389 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:24.758765 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0002458-3afd-4aff-b342-be2059ca182f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:24.759414 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0002458-3afd-4aff-b342-be2059ca182f None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:24.759694 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0002458-3afd-4aff-b342-be2059ca182f None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:24.759964 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0002458-3afd-4aff-b342-be2059ca182f None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:24.760626 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0002458-3afd-4aff-b342-be2059ca182f None admin] RBAC: Adding query filter params (type=compute) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:14:24.760925 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0002458-3afd-4aff-b342-be2059ca182f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:24.762276 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0002458-3afd-4aff-b342-be2059ca182f None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:24.766883 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 399/820] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Jul 27 20:14:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:14:24.773093 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841f965-eab0-4c0e-a9f1-f9ea7e5af899 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:14:24.867056 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841f965-eab0-4c0e-a9f1-f9ea7e5af899 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:14:24.894312 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:24.900521 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c77e09-43a5-4800-8ac4-f46e52b9db40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:14:24.901122 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c77e09-43a5-4800-8ac4-f46e52b9db40 None admin] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:14:24.901400 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c77e09-43a5-4800-8ac4-f46e52b9db40 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:14:24.901664 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c77e09-43a5-4800-8ac4-f46e52b9db40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:14:24.902361 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c77e09-43a5-4800-8ac4-f46e52b9db40 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:14:24.903746 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c77e09-43a5-4800-8ac4-f46e52b9db40 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:14:24.931509 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 422/821] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Jul 27 20:14:24 2022] POST /identity/v3/endpoints => generated 334 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:14:34.764515 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=10 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:34.925487 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=6,keystone:INSERT=1 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:25.749631 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77cefd-4aba-4eb1-a2a3-e9d3357b67c2 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:25.750218 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77cefd-4aba-4eb1-a2a3-e9d3357b67c2 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:25.750218 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77cefd-4aba-4eb1-a2a3-e9d3357b67c2 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:25.751561 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 400/822] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:15:25.761245 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5344d64-cd53-4568-a3f9-497d80368cb0 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:25.761245 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5344d64-cd53-4568-a3f9-497d80368cb0 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:25.761245 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5344d64-cd53-4568-a3f9-497d80368cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:25.778623 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-d5344d64-cd53-4568-a3f9-497d80368cb0 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:15:25.779865 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-d5344d64-cd53-4568-a3f9-497d80368cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:15:25.871978 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 423/823] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:15:25 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:15:25.900958 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77cefd-4aba-4eb1-a2a3-e9d3357b67c2 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:26.058062 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77cefd-4aba-4eb1-a2a3-e9d3357b67c2 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:26.103926 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68de562-cb00-4a7b-8bb5-ac334f32981f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:26.104572 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68de562-cb00-4a7b-8bb5-ac334f32981f None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:26.104874 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68de562-cb00-4a7b-8bb5-ac334f32981f None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:26.105347 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68de562-cb00-4a7b-8bb5-ac334f32981f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:26.118061 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68de562-cb00-4a7b-8bb5-ac334f32981f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:26.120028 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68de562-cb00-4a7b-8bb5-ac334f32981f None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:26.139593 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-b68de562-cb00-4a7b-8bb5-ac334f32981f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:15:26.139593 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:26.139593 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:26.139593 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:26.139593 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:26.139593 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:26.139593 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:26.139593 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:26.139593 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:26.139593 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:26.139593 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:26.139593 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:26.139593 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:15:26.139593 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:15:26.139593 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:15:26.140709 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:15:26.140709 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:26.140709 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:26.140709 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:26.140709 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:26.140709 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:26.140709 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:26.140709 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:26.140709 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:26.140709 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:26.140709 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:26.140709 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:26.140709 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:26.140709 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:26.140709 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:26.140709 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:26.140709 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:26.141698 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:15:26.141698 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:15:26.141698 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:15:26.141698 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:15:26.146510 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 401/824] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:26.147505 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5344d64-cd53-4568-a3f9-497d80368cb0 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:26.283879 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5344d64-cd53-4568-a3f9-497d80368cb0 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:26.333612 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:26.346165 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a509c-1e21-4ba2-80ce-1983b04b56d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:26.346870 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a509c-1e21-4ba2-80ce-1983b04b56d2 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:26.347182 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a509c-1e21-4ba2-80ce-1983b04b56d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:26.347460 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a509c-1e21-4ba2-80ce-1983b04b56d2 None admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:26.348172 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a509c-1e21-4ba2-80ce-1983b04b56d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:26.348464 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a509c-1e21-4ba2-80ce-1983b04b56d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:26.349847 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a509c-1e21-4ba2-80ce-1983b04b56d2 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:26.362640 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 424/825] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:15:26.368892 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68de562-cb00-4a7b-8bb5-ac334f32981f None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:26.431045 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:26.487013 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68de562-cb00-4a7b-8bb5-ac334f32981f None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:26.532108 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736ec62-f2a6-42ae-87ef-b3495b28ecc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:26.532733 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736ec62-f2a6-42ae-87ef-b3495b28ecc7 None admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:26.533134 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736ec62-f2a6-42ae-87ef-b3495b28ecc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:26.533410 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736ec62-f2a6-42ae-87ef-b3495b28ecc7 None admin] PATH_INFO: `/v3/users` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:26.534331 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736ec62-f2a6-42ae-87ef-b3495b28ecc7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:26.536605 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736ec62-f2a6-42ae-87ef-b3495b28ecc7 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:26.579451 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 402/826] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 27 20:15:26 2022] POST /identity/v3/users => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:15:28.967580 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb045ba6-4695-4a4f-b99d-12540ec99e64 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:28.968138 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb045ba6-4695-4a4f-b99d-12540ec99e64 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:28.968490 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb045ba6-4695-4a4f-b99d-12540ec99e64 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:28.970633 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 425/827] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:15:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 20:15:28.977341 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0115cc-3545-4a9c-979c-14172954158e None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:28.977810 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0115cc-3545-4a9c-979c-14172954158e None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:28.978297 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0115cc-3545-4a9c-979c-14172954158e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:29.002347 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-9e0115cc-3545-4a9c-979c-14172954158e None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:15:29.003587 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-9e0115cc-3545-4a9c-979c-14172954158e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:15:29.093784 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 403/828] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:15:28 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 20:15:29.122911 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb045ba6-4695-4a4f-b99d-12540ec99e64 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:29.238478 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb045ba6-4695-4a4f-b99d-12540ec99e64 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:29.280274 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452335c-1288-430c-b05a-c96e7b88f5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:29.280963 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452335c-1288-430c-b05a-c96e7b88f5cb None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:29.281240 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452335c-1288-430c-b05a-c96e7b88f5cb None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:29.281525 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452335c-1288-430c-b05a-c96e7b88f5cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:29.293054 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452335c-1288-430c-b05a-c96e7b88f5cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:15:29.298277 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-3452335c-1288-430c-b05a-c96e7b88f5cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:15:29.298277 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:29.298277 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:29.298277 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:29.298277 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:29.298277 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:29.298277 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:29.298277 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:29.298277 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:29.298277 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:29.298277 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:29.298277 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:29.298277 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:15:29.298277 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:15:29.298277 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:15:29.298277 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:15:29.299595 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:15:29.299595 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:15:29.299595 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:15:29.299595 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:15:29.299595 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:29.299595 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:29.299595 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:29.299595 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:29.299595 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:29.299595 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:29.299595 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:29.299595 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:29.299595 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:29.299595 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:29.299595 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:29.299595 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:29.300604 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:29.300604 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:29.300604 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:29.300604 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:29.300604 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:15:29.300604 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:15:29.300604 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:15:29.300604 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:15:29.300604 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:15:29.300604 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:15:29.300604 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:15:29.300604 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:15:29.300604 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 426/829] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 27 20:15:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:29.306163 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0115cc-3545-4a9c-979c-14172954158e None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:29.351358 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:29.416355 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0115cc-3545-4a9c-979c-14172954158e None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:29.457107 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bf2ec-73c1-4378-91f1-2d68c454592c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:29.457804 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bf2ec-73c1-4378-91f1-2d68c454592c None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:29.458087 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bf2ec-73c1-4378-91f1-2d68c454592c None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:29.458360 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bf2ec-73c1-4378-91f1-2d68c454592c None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:29.459168 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9bf2ec-73c1-4378-91f1-2d68c454592c None admin] RBAC: Adding query filter params (name=service) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:29.459486 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9bf2ec-73c1-4378-91f1-2d68c454592c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:29.460973 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9bf2ec-73c1-4378-91f1-2d68c454592c None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:29.470285 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 404/830] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 27 20:15:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:15:29.475250 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452335c-1288-430c-b05a-c96e7b88f5cb None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:29.524917 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:29.587384 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452335c-1288-430c-b05a-c96e7b88f5cb None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:29.625291 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a60053-466c-4e82-8250-d1d7b7e0b1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:29.626705 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a60053-466c-4e82-8250-d1d7b7e0b1b2 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:29.626705 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a60053-466c-4e82-8250-d1d7b7e0b1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:29.626905 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a60053-466c-4e82-8250-d1d7b7e0b1b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:29.643172 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a60053-466c-4e82-8250-d1d7b7e0b1b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:29.644826 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a60053-466c-4e82-8250-d1d7b7e0b1b2 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:29.662347 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-68a60053-466c-4e82-8250-d1d7b7e0b1b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:15:29.662347 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:29.662347 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:29.662347 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:29.662347 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:29.662347 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:29.662347 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:29.662347 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:29.662347 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:29.662347 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:29.662347 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:29.662347 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:29.662347 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:15:29.662347 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:15:29.662347 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:15:29.663638 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:15:29.663638 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:29.663638 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:29.663638 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:29.663638 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:29.663638 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:29.663638 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:29.663638 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:29.663638 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:29.663638 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:29.663638 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:29.663638 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:29.663638 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:29.663638 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:29.663638 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:29.663638 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:29.663638 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:29.664790 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:15:29.664790 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:15:29.664790 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:15:29.664790 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:15:29.664790 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 427/831] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:15:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:29.670949 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bf2ec-73c1-4378-91f1-2d68c454592c None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:29.781097 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:29.784311 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bf2ec-73c1-4378-91f1-2d68c454592c None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:29.822401 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f09bdc-f452-4141-8f09-7201c663a60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:29.823157 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f09bdc-f452-4141-8f09-7201c663a60e None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:29.823398 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f09bdc-f452-4141-8f09-7201c663a60e None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:29.823674 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f09bdc-f452-4141-8f09-7201c663a60e None admin] PATH_INFO: `/v3/domains` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:29.824468 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f09bdc-f452-4141-8f09-7201c663a60e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:29.824788 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f09bdc-f452-4141-8f09-7201c663a60e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:29.826247 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f09bdc-f452-4141-8f09-7201c663a60e None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:29.839196 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 405/832] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:15:29.845731 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a60053-466c-4e82-8250-d1d7b7e0b1b2 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:29.962710 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:29.968504 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a60053-466c-4e82-8250-d1d7b7e0b1b2 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:30.007005 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118c2f9-d419-4205-a59e-ed3128184cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:30.007839 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118c2f9-d419-4205-a59e-ed3128184cca None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:30.008081 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118c2f9-d419-4205-a59e-ed3128184cca None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:30.008394 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118c2f9-d419-4205-a59e-ed3128184cca None admin] PATH_INFO: `/v3/users/placement` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:30.017947 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118c2f9-d419-4205-a59e-ed3128184cca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:30.019515 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118c2f9-d419-4205-a59e-ed3128184cca None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:30.038568 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-e118c2f9-d419-4205-a59e-ed3128184cca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 20:15:30.038568 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:30.038568 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:30.038568 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:30.038568 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:30.038568 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:30.038568 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:30.038568 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:30.038568 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:30.038568 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:30.038568 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:30.038568 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:30.038568 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 20:15:30.038568 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 20:15:30.038568 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 20:15:30.038568 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 20:15:30.039770 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:30.039770 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:30.039770 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 20:15:30.039770 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:15:30.039770 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 20:15:30.039770 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:15:30.039770 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:30.039770 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:30.039770 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:30.039770 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:30.039770 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:30.039770 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:30.039770 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:30.039770 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:30.039770 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:30.039770 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:30.039770 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:30.039770 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:30.047976 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:30.047976 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:30.047976 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 20:15:30.047976 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 20:15:30.047976 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 20:15:30.047976 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 20:15:30.047976 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 20:15:30.047976 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 20:15:30.047976 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 20:15:30.047976 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:15:30.047976 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 428/833] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:15:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:30.049051 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f09bdc-f452-4141-8f09-7201c663a60e None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:30.163476 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f09bdc-f452-4141-8f09-7201c663a60e None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:30.206336 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea46030-0c4e-4660-a9c5-938d7a58dcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:30.207131 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea46030-0c4e-4660-a9c5-938d7a58dcfd None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:30.207501 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea46030-0c4e-4660-a9c5-938d7a58dcfd None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:30.207878 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea46030-0c4e-4660-a9c5-938d7a58dcfd None admin] PATH_INFO: `/v3/users` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:30.208761 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea46030-0c4e-4660-a9c5-938d7a58dcfd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:30.209165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea46030-0c4e-4660-a9c5-938d7a58dcfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:30.210681 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea46030-0c4e-4660-a9c5-938d7a58dcfd None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:30.229260 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 406/834] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Jul 27 20:15:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:30.235318 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118c2f9-d419-4205-a59e-ed3128184cca None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:30.345452 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118c2f9-d419-4205-a59e-ed3128184cca None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:30.381604 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e11cd7-6bb6-4ac5-9fb5-27cf7b4b7048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:30.382273 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e11cd7-6bb6-4ac5-9fb5-27cf7b4b7048 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:30.382603 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e11cd7-6bb6-4ac5-9fb5-27cf7b4b7048 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:30.382879 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e11cd7-6bb6-4ac5-9fb5-27cf7b4b7048 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:30.410710 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:30.456680 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e11cd7-6bb6-4ac5-9fb5-27cf7b4b7048 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:30.458285 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e11cd7-6bb6-4ac5-9fb5-27cf7b4b7048 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:30.563402 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 429/835] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:15:30 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 20:15:30.569254 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea46030-0c4e-4660-a9c5-938d7a58dcfd None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:30.588242 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:30.672498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea46030-0c4e-4660-a9c5-938d7a58dcfd None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:30.710480 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d8b20-4e61-4e57-a267-8f2d698ed6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:30.711587 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d8b20-4e61-4e57-a267-8f2d698ed6aa None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:30.713491 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d8b20-4e61-4e57-a267-8f2d698ed6aa None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:30.713491 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d8b20-4e61-4e57-a267-8f2d698ed6aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:30.723967 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d8b20-4e61-4e57-a267-8f2d698ed6aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:30.725536 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d8b20-4e61-4e57-a267-8f2d698ed6aa None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:30.741774 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-896d8b20-4e61-4e57-a267-8f2d698ed6aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:15:30.741774 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:30.741774 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:30.741774 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:30.741774 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:30.741774 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:30.741774 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:30.741774 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:30.741774 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:30.741774 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:30.741774 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:30.741774 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:30.741774 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:15:30.741774 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:15:30.741774 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:15:30.742889 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:15:30.742889 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:30.742889 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:30.742889 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:30.742889 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:30.742889 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:30.742889 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:30.742889 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:30.742889 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:30.742889 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:30.742889 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:30.742889 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:30.742889 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:30.742889 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:30.742889 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:30.742889 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:30.742889 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:30.744450 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:15:30.744450 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:15:30.744450 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:15:30.744450 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:15:30.744450 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 407/836] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:15:30.749892 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e11cd7-6bb6-4ac5-9fb5-27cf7b4b7048 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:30.807579 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:30.853467 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e11cd7-6bb6-4ac5-9fb5-27cf7b4b7048 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:30.891991 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b4165-c3cd-4601-ab5d-d08e31e004bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:30.892611 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b4165-c3cd-4601-ab5d-d08e31e004bb None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:30.892888 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b4165-c3cd-4601-ab5d-d08e31e004bb None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:30.893160 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b4165-c3cd-4601-ab5d-d08e31e004bb None admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:30.893842 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b4165-c3cd-4601-ab5d-d08e31e004bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:30.894148 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b4165-c3cd-4601-ab5d-d08e31e004bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:30.895702 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b4165-c3cd-4601-ab5d-d08e31e004bb None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:30.907650 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 430/837] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:30.913563 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d8b20-4e61-4e57-a267-8f2d698ed6aa None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:30.999574 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:31.033766 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d8b20-4e61-4e57-a267-8f2d698ed6aa None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:31.069405 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1bae4-3bb5-46bd-af52-aceb2e461333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:31.070042 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1bae4-3bb5-46bd-af52-aceb2e461333 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:31.070317 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1bae4-3bb5-46bd-af52-aceb2e461333 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:31.070591 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1bae4-3bb5-46bd-af52-aceb2e461333 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:31.077122 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1bae4-3bb5-46bd-af52-aceb2e461333 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:31.078552 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1bae4-3bb5-46bd-af52-aceb2e461333 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:31.090569 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-0ed1bae4-3bb5-46bd-af52-aceb2e461333 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:15:31.090569 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:31.090569 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:31.090569 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:31.090569 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:31.090569 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:31.090569 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:31.090569 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:31.090569 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:31.090569 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:31.090569 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:31.090569 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:31.090569 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 20:15:31.090569 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 20:15:31.090569 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 20:15:31.091750 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 20:15:31.091750 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:31.091750 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:31.091750 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:31.091750 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:31.091750 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:31.091750 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:31.091750 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:31.091750 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:31.091750 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:31.091750 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:31.091750 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:31.091750 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:31.091750 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:31.091750 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:31.091750 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:31.091750 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:31.097797 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 20:15:31.097797 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 20:15:31.097797 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 20:15:31.097797 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 20:15:31.097797 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 20:15:31.097797 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 20:15:31.097797 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:15:31.097797 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:15:31.097797 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 408/838] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:15:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:31.098403 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b4165-c3cd-4601-ab5d-d08e31e004bb None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:31.204440 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b4165-c3cd-4601-ab5d-d08e31e004bb None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:31.223605 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:31.242465 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c680c1-636d-492f-a538-800b55d356d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:31.243130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c680c1-636d-492f-a538-800b55d356d2 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:31.243408 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c680c1-636d-492f-a538-800b55d356d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:31.243677 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c680c1-636d-492f-a538-800b55d356d2 None admin] PATH_INFO: `/v3/projects` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:31.244679 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c680c1-636d-492f-a538-800b55d356d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:31.244989 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c680c1-636d-492f-a538-800b55d356d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:31.246503 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c680c1-636d-492f-a538-800b55d356d2 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:31.258879 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 431/839] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 27 20:15:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:15:31.265423 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1bae4-3bb5-46bd-af52-aceb2e461333 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:31.387321 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1bae4-3bb5-46bd-af52-aceb2e461333 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:31.419640 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:31.423484 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2a308-d0f9-4b28-8c77-7b0760b6951f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:31.424304 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2a308-d0f9-4b28-8c77-7b0760b6951f None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:31.424586 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2a308-d0f9-4b28-8c77-7b0760b6951f None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:31.424867 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2a308-d0f9-4b28-8c77-7b0760b6951f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:31.425632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2a308-d0f9-4b28-8c77-7b0760b6951f None admin] RBAC: Adding query filter params (role.id=49069056c7b14e319599004c4af25dfb, scope.project.id=75313278ff3747909a57b6f37496d31e, user.id=733839729aa249e0823f24a8e8fb3ffe) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:31.425938 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2a308-d0f9-4b28-8c77-7b0760b6951f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:31.427395 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2a308-d0f9-4b28-8c77-7b0760b6951f None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:31.433892 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 409/840] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:15:31 2022] GET /identity/v3/role_assignments?user.id=733839729aa249e0823f24a8e8fb3ffe&scope.project.id=75313278ff3747909a57b6f37496d31e&role.id=49069056c7b14e319599004c4af25dfb => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:33.694732 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1147214-4b40-496c-9fb6-a5e42c607ffe None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:33.695276 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1147214-4b40-496c-9fb6-a5e42c607ffe None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:33.695276 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1147214-4b40-496c-9fb6-a5e42c607ffe None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:33.696569 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 432/841] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:15:33.702355 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1672494-e34b-4aad-9ef7-741f6a63850d None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:33.702801 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1672494-e34b-4aad-9ef7-741f6a63850d None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:33.702922 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1672494-e34b-4aad-9ef7-741f6a63850d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:33.720819 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-e1672494-e34b-4aad-9ef7-741f6a63850d None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:15:33.722030 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-e1672494-e34b-4aad-9ef7-741f6a63850d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:15:33.800571 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 410/842] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:15:33 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:15:33.824804 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1147214-4b40-496c-9fb6-a5e42c607ffe None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:33.931689 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1147214-4b40-496c-9fb6-a5e42c607ffe None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:33.974489 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1e067-2bf5-4d7b-b160-915ccd2a717c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:33.975354 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1e067-2bf5-4d7b-b160-915ccd2a717c None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:33.975645 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1e067-2bf5-4d7b-b160-915ccd2a717c None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:33.975945 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1e067-2bf5-4d7b-b160-915ccd2a717c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:33.987022 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1e067-2bf5-4d7b-b160-915ccd2a717c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:15:33.993290 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-6bb1e067-2bf5-4d7b-b160-915ccd2a717c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:15:33.993290 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:33.993290 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:33.993290 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:33.993290 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:33.993290 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:33.993290 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:33.993290 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:33.993290 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:33.993290 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:33.993290 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:33.993290 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:33.993290 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:15:33.993290 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:15:33.993290 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:15:33.993290 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:15:33.994760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:15:33.994760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:15:33.994760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:15:33.994760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:15:33.994760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:33.994760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:33.994760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:33.994760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:33.994760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:33.994760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:33.994760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:33.994760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:33.994760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:33.994760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:33.994760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:33.994760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:33.996507 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:33.996507 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:33.996507 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:33.996507 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:33.996507 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:15:33.996507 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:15:33.996507 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:15:33.996507 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:15:33.996507 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:15:33.996507 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:15:33.996507 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:15:33.996507 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:15:33.996507 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 433/843] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 27 20:15:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:34.001938 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1672494-e34b-4aad-9ef7-741f6a63850d None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:34.109569 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1672494-e34b-4aad-9ef7-741f6a63850d None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:34.135353 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:34.149064 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ced341-1b69-412b-99f5-d75745b85e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:34.150124 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ced341-1b69-412b-99f5-d75745b85e02 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:34.150428 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ced341-1b69-412b-99f5-d75745b85e02 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:34.150739 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ced341-1b69-412b-99f5-d75745b85e02 None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:34.151590 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ced341-1b69-412b-99f5-d75745b85e02 None admin] RBAC: Adding query filter params (name=service) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:34.151915 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ced341-1b69-412b-99f5-d75745b85e02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:34.153462 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ced341-1b69-412b-99f5-d75745b85e02 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:34.162860 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 411/844] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 27 20:15:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:34.169383 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1e067-2bf5-4d7b-b160-915ccd2a717c None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:34.215682 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:34.284705 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1e067-2bf5-4d7b-b160-915ccd2a717c None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:34.326414 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bc8b6-8225-4ffa-bc5b-05af7b2af394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:34.327145 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bc8b6-8225-4ffa-bc5b-05af7b2af394 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:34.327429 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bc8b6-8225-4ffa-bc5b-05af7b2af394 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:34.327703 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bc8b6-8225-4ffa-bc5b-05af7b2af394 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:34.338651 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bc8b6-8225-4ffa-bc5b-05af7b2af394 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:34.340386 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bc8b6-8225-4ffa-bc5b-05af7b2af394 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:34.360661 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-786bc8b6-8225-4ffa-bc5b-05af7b2af394 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:15:34.360661 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:34.360661 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:34.360661 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:34.360661 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:34.360661 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:34.360661 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:34.360661 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:34.360661 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:34.360661 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:34.360661 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:34.360661 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:34.360661 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:15:34.360661 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:15:34.360661 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:15:34.361763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:15:34.361763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:34.361763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:34.361763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:34.361763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:34.361763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:34.361763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:34.361763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:34.361763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:34.361763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:34.361763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:34.361763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:34.361763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:34.361763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:34.361763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:34.361763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:34.361763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:34.362796 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:15:34.362796 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:15:34.362796 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:15:34.362796 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:15:34.362796 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 434/845] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:34.371573 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ced341-1b69-412b-99f5-d75745b85e02 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:34.479244 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ced341-1b69-412b-99f5-d75745b85e02 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:34.518443 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0e604-1a8a-47ad-b1de-498a9461debc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:34.519151 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0e604-1a8a-47ad-b1de-498a9461debc None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:34.519491 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0e604-1a8a-47ad-b1de-498a9461debc None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:34.519839 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0e604-1a8a-47ad-b1de-498a9461debc None admin] PATH_INFO: `/v3/domains` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:34.520551 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0e604-1a8a-47ad-b1de-498a9461debc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:34.520888 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0e604-1a8a-47ad-b1de-498a9461debc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:34.522276 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0e604-1a8a-47ad-b1de-498a9461debc None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:34.535212 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 412/846] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:15:34.540742 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bc8b6-8225-4ffa-bc5b-05af7b2af394 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:34.644400 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:34.654617 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bc8b6-8225-4ffa-bc5b-05af7b2af394 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:34.690680 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b500c9-84e3-4399-9f67-a09862eda37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:34.691354 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b500c9-84e3-4399-9f67-a09862eda37c None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:34.691635 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b500c9-84e3-4399-9f67-a09862eda37c None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:34.691911 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b500c9-84e3-4399-9f67-a09862eda37c None admin] PATH_INFO: `/v3/users/placement` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:34.699464 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b500c9-84e3-4399-9f67-a09862eda37c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:34.700896 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b500c9-84e3-4399-9f67-a09862eda37c None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:34.712247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-21b500c9-84e3-4399-9f67-a09862eda37c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 20:15:34.712247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:34.712247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:34.712247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:34.712247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:34.712247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:34.712247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:34.712247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:34.712247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:34.712247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:34.712247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:34.712247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:34.712247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 20:15:34.712247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 20:15:34.712247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 20:15:34.712247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 20:15:34.713411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:34.713411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:34.713411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 20:15:34.713411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:15:34.713411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 20:15:34.713411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:15:34.713411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:34.713411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:34.713411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:34.713411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:34.713411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:34.713411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:34.713411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:34.713411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:34.713411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:34.713411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:34.713411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:34.713411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:34.715494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:34.715494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:34.715494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 20:15:34.715494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 20:15:34.715494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 20:15:34.715494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 20:15:34.715494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 20:15:34.715494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 20:15:34.715494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 20:15:34.715494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:15:34.715494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 435/847] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:15:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:34.720257 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0e604-1a8a-47ad-b1de-498a9461debc None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:34.769945 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:34.831357 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0e604-1a8a-47ad-b1de-498a9461debc None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:34.868631 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74143c-e8e6-4bf2-801f-6b31f8c2566e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:34.869502 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74143c-e8e6-4bf2-801f-6b31f8c2566e None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:34.869781 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74143c-e8e6-4bf2-801f-6b31f8c2566e None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:34.870051 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74143c-e8e6-4bf2-801f-6b31f8c2566e None admin] PATH_INFO: `/v3/users` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:34.870884 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74143c-e8e6-4bf2-801f-6b31f8c2566e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:34.871224 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74143c-e8e6-4bf2-801f-6b31f8c2566e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:34.872655 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74143c-e8e6-4bf2-801f-6b31f8c2566e None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:34.890240 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 413/848] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Jul 27 20:15:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:15:34.897117 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b500c9-84e3-4399-9f67-a09862eda37c None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:35.017286 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b500c9-84e3-4399-9f67-a09862eda37c None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:35.052571 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222e092-fc24-4c34-a21f-adadef9afe3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:35.053215 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222e092-fc24-4c34-a21f-adadef9afe3f None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:35.053495 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222e092-fc24-4c34-a21f-adadef9afe3f None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:35.053771 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222e092-fc24-4c34-a21f-adadef9afe3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:35.064379 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222e092-fc24-4c34-a21f-adadef9afe3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:35.065832 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222e092-fc24-4c34-a21f-adadef9afe3f None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:35.080434 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-8222e092-fc24-4c34-a21f-adadef9afe3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:15:35.080434 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:35.080434 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:35.080434 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:35.080434 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:35.080434 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:35.080434 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:35.080434 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:35.080434 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:35.080434 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:35.080434 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:35.080434 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:35.080434 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:15:35.080434 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:15:35.080434 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:15:35.082023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:15:35.082023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:35.082023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:35.082023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:35.082023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:35.082023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:35.082023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:35.082023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:35.082023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:35.082023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:35.082023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:35.082023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:35.082023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:35.082023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:35.082023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:35.082023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:35.082023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:35.083549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:15:35.083549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:15:35.083549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:15:35.083549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:15:35.083549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 436/849] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:35.087685 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74143c-e8e6-4bf2-801f-6b31f8c2566e None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:35.202546 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74143c-e8e6-4bf2-801f-6b31f8c2566e None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:35.205699 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:35.240060 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ee2b2-3868-493f-a99b-89b46ce43fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:35.241033 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ee2b2-3868-493f-a99b-89b46ce43fcf None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:35.241347 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ee2b2-3868-493f-a99b-89b46ce43fcf None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:35.241671 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ee2b2-3868-493f-a99b-89b46ce43fcf None admin] PATH_INFO: `/v3/domains` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:35.242444 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ee2b2-3868-493f-a99b-89b46ce43fcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:35.242750 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ee2b2-3868-493f-a99b-89b46ce43fcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:35.244502 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ee2b2-3868-493f-a99b-89b46ce43fcf None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:35.256881 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 414/850] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:35.263339 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222e092-fc24-4c34-a21f-adadef9afe3f None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:35.266261 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:35.377288 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222e092-fc24-4c34-a21f-adadef9afe3f None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:35.412758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79d0c7-5d34-40df-bcb9-766031ad84ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:35.413537 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79d0c7-5d34-40df-bcb9-766031ad84ba None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:35.413874 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79d0c7-5d34-40df-bcb9-766031ad84ba None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:35.414205 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79d0c7-5d34-40df-bcb9-766031ad84ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:35.420780 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79d0c7-5d34-40df-bcb9-766031ad84ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:35.422208 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79d0c7-5d34-40df-bcb9-766031ad84ba None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:35.433044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-2f79d0c7-5d34-40df-bcb9-766031ad84ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:15:35.433044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:35.433044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:35.433044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:35.433044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:35.433044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:35.433044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:35.433044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:35.433044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:35.433044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:35.433044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:35.433044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:35.433044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 20:15:35.433044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 20:15:35.433044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 20:15:35.434614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 20:15:35.434614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:35.434614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:35.434614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:35.434614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:35.434614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:35.434614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:35.434614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:35.434614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:35.434614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:35.434614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:35.434614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:35.434614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:35.434614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:35.434614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:35.434614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:35.434614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:35.435660 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 20:15:35.435660 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 20:15:35.435660 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 20:15:35.435660 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 20:15:35.435660 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 20:15:35.435660 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 20:15:35.435660 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:15:35.435660 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:15:35.435660 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 437/851] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:15:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:35.440902 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ee2b2-3868-493f-a99b-89b46ce43fcf None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:35.555169 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ee2b2-3868-493f-a99b-89b46ce43fcf None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:35.595011 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e0dc8-4c58-4873-a3b1-6971858ba031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:35.596152 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e0dc8-4c58-4873-a3b1-6971858ba031 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:35.596576 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e0dc8-4c58-4873-a3b1-6971858ba031 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:35.596886 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e0dc8-4c58-4873-a3b1-6971858ba031 None admin] PATH_INFO: `/v3/projects` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:35.598199 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e0dc8-4c58-4873-a3b1-6971858ba031 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:35.598674 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e0dc8-4c58-4873-a3b1-6971858ba031 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:35.600544 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e0dc8-4c58-4873-a3b1-6971858ba031 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:35.616333 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 415/852] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 27 20:15:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:35.622879 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79d0c7-5d34-40df-bcb9-766031ad84ba None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:35.688130 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:35.735104 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79d0c7-5d34-40df-bcb9-766031ad84ba None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:35.775771 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81e42f-7c8a-4c35-b024-d61ab5d62a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:35.776435 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81e42f-7c8a-4c35-b024-d61ab5d62a94 None admin] REQUEST_METHOD: `PUT` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:35.776713 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81e42f-7c8a-4c35-b024-d61ab5d62a94 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:35.777011 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81e42f-7c8a-4c35-b024-d61ab5d62a94 None admin] PATH_INFO: `/v3/projects/75313278ff3747909a57b6f37496d31e/users/733839729aa249e0823f24a8e8fb3ffe/roles/49069056c7b14e319599004c4af25dfb` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:35.794209 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f81e42f-7c8a-4c35-b024-d61ab5d62a94 None admin] RBAC: Authorizing `identity:create_grant(project_id=75313278ff3747909a57b6f37496d31e, user_id=733839729aa249e0823f24a8e8fb3ffe, role_id=49069056c7b14e319599004c4af25dfb)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:35.796301 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f81e42f-7c8a-4c35-b024-d61ab5d62a94 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:35.809516 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 438/853] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 27 20:15:35 2022] PUT /identity/v3/projects/75313278ff3747909a57b6f37496d31e/users/733839729aa249e0823f24a8e8fb3ffe/roles/49069056c7b14e319599004c4af25dfb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 20:15:38.192300 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a23ae7-0f2c-4184-91a1-87a87b4162f6 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:38.196416 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a23ae7-0f2c-4184-91a1-87a87b4162f6 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:38.196416 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a23ae7-0f2c-4184-91a1-87a87b4162f6 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:38.196416 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 416/854] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:15:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:15:38.202314 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1ab61-0a6d-4084-9811-08813b1758a8 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:38.202901 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1ab61-0a6d-4084-9811-08813b1758a8 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:38.202901 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1ab61-0a6d-4084-9811-08813b1758a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:38.222616 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-27c1ab61-0a6d-4084-9811-08813b1758a8 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:15:38.223916 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-27c1ab61-0a6d-4084-9811-08813b1758a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:15:38.300085 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 439/855] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:15:38 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:15:38.326624 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a23ae7-0f2c-4184-91a1-87a87b4162f6 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:38.355956 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:38.456859 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a23ae7-0f2c-4184-91a1-87a87b4162f6 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:38.494170 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8eb0a-4983-4534-aeeb-288030fc9222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:38.494819 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8eb0a-4983-4534-aeeb-288030fc9222 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:38.495134 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8eb0a-4983-4534-aeeb-288030fc9222 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:38.495463 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8eb0a-4983-4534-aeeb-288030fc9222 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:38.507435 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8eb0a-4983-4534-aeeb-288030fc9222 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:15:38.513431 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-0dd8eb0a-4983-4534-aeeb-288030fc9222 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:15:38.513431 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:38.513431 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:38.513431 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:38.513431 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:38.513431 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:38.513431 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:38.513431 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:38.513431 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:38.513431 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:38.513431 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:38.513431 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:38.513431 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:15:38.513431 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:15:38.513431 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:15:38.513431 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:15:38.514632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:15:38.514632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:15:38.514632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:15:38.514632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:15:38.514632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:38.514632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:38.514632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:38.514632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:38.514632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:38.514632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:38.514632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:38.514632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:38.514632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:38.514632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:38.514632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:38.514632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:38.515707 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:38.515707 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:38.515707 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:38.515707 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:38.515707 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:15:38.515707 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:15:38.515707 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:15:38.515707 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:15:38.515707 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:15:38.515707 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:15:38.515707 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 20:15:38.515707 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:15:38.515707 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 417/856] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 27 20:15:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:38.520847 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1ab61-0a6d-4084-9811-08813b1758a8 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:38.570950 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:38.634681 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1ab61-0a6d-4084-9811-08813b1758a8 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:38.672731 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af66471-7b9a-4965-a5be-849cde005ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:38.673532 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af66471-7b9a-4965-a5be-849cde005ac9 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:38.673815 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af66471-7b9a-4965-a5be-849cde005ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:38.674095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af66471-7b9a-4965-a5be-849cde005ac9 None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:38.674919 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af66471-7b9a-4965-a5be-849cde005ac9 None admin] RBAC: Adding query filter params (name=service) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:38.675300 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af66471-7b9a-4965-a5be-849cde005ac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:38.676959 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af66471-7b9a-4965-a5be-849cde005ac9 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:38.686947 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 440/857] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 27 20:15:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:38.693503 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8eb0a-4983-4534-aeeb-288030fc9222 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:38.805685 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:38.828005 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8eb0a-4983-4534-aeeb-288030fc9222 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:38.865408 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f2967-4c92-4b73-8562-0d96f648593e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:38.866075 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f2967-4c92-4b73-8562-0d96f648593e None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:38.866324 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f2967-4c92-4b73-8562-0d96f648593e None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:38.866596 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f2967-4c92-4b73-8562-0d96f648593e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:38.877934 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f2967-4c92-4b73-8562-0d96f648593e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:38.879524 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f2967-4c92-4b73-8562-0d96f648593e None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:38.895352 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-bc4f2967-4c92-4b73-8562-0d96f648593e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:15:38.895352 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:38.895352 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:38.895352 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:38.895352 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:38.895352 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:38.895352 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:38.895352 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:38.895352 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:38.895352 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:38.895352 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:38.895352 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:38.895352 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:15:38.895352 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:15:38.895352 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:15:38.896426 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:15:38.896426 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:38.896426 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:38.896426 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:38.896426 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:38.896426 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:38.896426 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:38.896426 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:38.896426 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:38.896426 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:38.896426 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:38.896426 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:38.896426 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:38.896426 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:38.896426 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:38.896426 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:38.896426 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:38.897688 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:15:38.897688 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:15:38.897688 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:15:38.897688 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:15:38.897688 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 418/858] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:15:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:38.903301 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af66471-7b9a-4965-a5be-849cde005ac9 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:39.019258 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af66471-7b9a-4965-a5be-849cde005ac9 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:39.022027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:39.068973 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ed3e9-10ba-4063-b3fd-1848475bf87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:39.069518 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ed3e9-10ba-4063-b3fd-1848475bf87b None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:39.069792 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ed3e9-10ba-4063-b3fd-1848475bf87b None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:39.070063 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ed3e9-10ba-4063-b3fd-1848475bf87b None admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:39.070748 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ed3e9-10ba-4063-b3fd-1848475bf87b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:39.071046 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ed3e9-10ba-4063-b3fd-1848475bf87b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:39.072440 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ed3e9-10ba-4063-b3fd-1848475bf87b None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:39.084357 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 441/859] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:39.090403 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f2967-4c92-4b73-8562-0d96f648593e None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:39.206635 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f2967-4c92-4b73-8562-0d96f648593e None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:39.240623 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1f34f-887b-4497-874d-94a945b557a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:39.241262 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1f34f-887b-4497-874d-94a945b557a6 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:39.241547 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1f34f-887b-4497-874d-94a945b557a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:39.241839 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1f34f-887b-4497-874d-94a945b557a6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:39.244875 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:39.250266 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1f34f-887b-4497-874d-94a945b557a6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:39.252346 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1f34f-887b-4497-874d-94a945b557a6 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:39.265052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-84a1f34f-887b-4497-874d-94a945b557a6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 20:15:39.265052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:39.265052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:39.265052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:39.265052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:39.265052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:39.265052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:39.265052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:39.265052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:39.265052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:39.265052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:39.265052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:39.265052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 20:15:39.265052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 20:15:39.265052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 20:15:39.265052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 20:15:39.266116 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:39.266116 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:39.266116 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 20:15:39.266116 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:15:39.266116 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 20:15:39.266116 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:15:39.266116 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:39.266116 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:39.266116 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:39.266116 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:39.266116 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:39.266116 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:39.266116 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:39.266116 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:39.266116 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:39.266116 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:39.266116 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:39.266116 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:39.267126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:39.267126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:39.267126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 20:15:39.267126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 20:15:39.267126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 20:15:39.267126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 20:15:39.267126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 20:15:39.267126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 20:15:39.267126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 20:15:39.267126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:15:39.267126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 419/860] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:15:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:39.272391 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ed3e9-10ba-4063-b3fd-1848475bf87b None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:39.385659 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ed3e9-10ba-4063-b3fd-1848475bf87b None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:39.420866 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183b96e-b15f-449b-840a-f0aa8762e497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:39.421482 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183b96e-b15f-449b-840a-f0aa8762e497 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:39.421759 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183b96e-b15f-449b-840a-f0aa8762e497 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:39.422024 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183b96e-b15f-449b-840a-f0aa8762e497 None admin] PATH_INFO: `/v3/users` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:39.422798 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183b96e-b15f-449b-840a-f0aa8762e497 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:39.423128 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183b96e-b15f-449b-840a-f0aa8762e497 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:39.424558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183b96e-b15f-449b-840a-f0aa8762e497 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:39.441117 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 442/861] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Jul 27 20:15:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:39.447556 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1f34f-887b-4497-874d-94a945b557a6 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:39.569755 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1f34f-887b-4497-874d-94a945b557a6 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:39.605573 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6ad21-3ab9-4e14-a6f4-a07c894d83c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:39.606375 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6ad21-3ab9-4e14-a6f4-a07c894d83c0 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:39.606716 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6ad21-3ab9-4e14-a6f4-a07c894d83c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:39.606993 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6ad21-3ab9-4e14-a6f4-a07c894d83c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:39.671674 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:39.678604 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6ad21-3ab9-4e14-a6f4-a07c894d83c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:39.680097 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6ad21-3ab9-4e14-a6f4-a07c894d83c0 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:39.784328 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 420/862] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:15:39 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 20:15:39.790474 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183b96e-b15f-449b-840a-f0aa8762e497 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:39.817529 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:39.901243 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183b96e-b15f-449b-840a-f0aa8762e497 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:39.939468 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e103530-2388-437a-bfe4-844d754f6bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:39.940040 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e103530-2388-437a-bfe4-844d754f6bfe None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:39.940332 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e103530-2388-437a-bfe4-844d754f6bfe None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:39.940589 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e103530-2388-437a-bfe4-844d754f6bfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:39.954662 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e103530-2388-437a-bfe4-844d754f6bfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:39.956288 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e103530-2388-437a-bfe4-844d754f6bfe None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:39.972981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-0e103530-2388-437a-bfe4-844d754f6bfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:15:39.972981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:39.972981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:39.972981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:39.972981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:39.972981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:39.972981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:39.972981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:39.972981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:39.972981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:39.972981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:39.972981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:39.972981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:15:39.972981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:15:39.972981 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:15:39.974048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:15:39.974048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:39.974048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:39.974048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:39.974048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:39.974048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:39.974048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:39.974048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:39.974048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:39.974048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:39.974048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:39.974048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:39.974048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:39.974048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:39.974048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:39.974048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:39.974048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:39.975163 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:15:39.975163 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:15:39.975163 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:15:39.975163 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:15:39.975163 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 443/863] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:15:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:39.980332 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6ad21-3ab9-4e14-a6f4-a07c894d83c0 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:40.076769 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:40.082692 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6ad21-3ab9-4e14-a6f4-a07c894d83c0 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:40.117493 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad3256-9904-4707-9022-4022476b507c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:40.118115 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad3256-9904-4707-9022-4022476b507c None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:40.118391 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad3256-9904-4707-9022-4022476b507c None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:40.118661 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad3256-9904-4707-9022-4022476b507c None admin] PATH_INFO: `/v3/domains` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:40.119633 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad3256-9904-4707-9022-4022476b507c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:40.119933 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad3256-9904-4707-9022-4022476b507c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:40.121813 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad3256-9904-4707-9022-4022476b507c None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:40.132967 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 421/864] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:40.139257 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e103530-2388-437a-bfe4-844d754f6bfe None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:40.216220 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:40.241598 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e103530-2388-437a-bfe4-844d754f6bfe None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:40.279338 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863929fc-7316-4197-baa7-1a4f66103451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:40.280007 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863929fc-7316-4197-baa7-1a4f66103451 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:40.280247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863929fc-7316-4197-baa7-1a4f66103451 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:40.280525 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863929fc-7316-4197-baa7-1a4f66103451 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:40.287661 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863929fc-7316-4197-baa7-1a4f66103451 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:40.289095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863929fc-7316-4197-baa7-1a4f66103451 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:40.300783 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-863929fc-7316-4197-baa7-1a4f66103451 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:15:40.300783 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:40.300783 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:40.300783 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:40.300783 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:40.300783 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:40.300783 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:40.300783 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:40.300783 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:40.300783 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:40.300783 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:40.300783 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:40.300783 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 20:15:40.300783 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 20:15:40.300783 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 20:15:40.301847 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 20:15:40.301847 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:40.301847 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:40.301847 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:40.301847 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:40.301847 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:40.301847 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:40.301847 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:40.301847 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:40.301847 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:40.301847 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:40.301847 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:40.301847 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:40.301847 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:40.301847 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:40.301847 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:40.301847 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:40.303644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 20:15:40.303644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 20:15:40.303644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 20:15:40.303644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 20:15:40.303644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 20:15:40.303644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 20:15:40.303644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:15:40.303644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:15:40.303644 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 444/865] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:15:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:40.307904 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad3256-9904-4707-9022-4022476b507c None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:40.418384 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad3256-9904-4707-9022-4022476b507c None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:40.457771 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e04442-7470-4409-9590-3bb0e8872e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:40.458396 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e04442-7470-4409-9590-3bb0e8872e49 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:40.458675 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e04442-7470-4409-9590-3bb0e8872e49 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:40.458946 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e04442-7470-4409-9590-3bb0e8872e49 None admin] PATH_INFO: `/v3/projects` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:40.459724 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e04442-7470-4409-9590-3bb0e8872e49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:40.460074 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e04442-7470-4409-9590-3bb0e8872e49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:40.461611 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e04442-7470-4409-9590-3bb0e8872e49 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:40.481621 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 422/866] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 27 20:15:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:40.482966 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863929fc-7316-4197-baa7-1a4f66103451 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:40.601338 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863929fc-7316-4197-baa7-1a4f66103451 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:40.639208 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7610a-a6a2-4b67-bea7-a26b16bfa8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:40.639826 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7610a-a6a2-4b67-bea7-a26b16bfa8a0 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:40.640107 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7610a-a6a2-4b67-bea7-a26b16bfa8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:40.640379 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7610a-a6a2-4b67-bea7-a26b16bfa8a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:40.641159 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7610a-a6a2-4b67-bea7-a26b16bfa8a0 None admin] RBAC: Adding query filter params (role.id=49069056c7b14e319599004c4af25dfb, scope.project.id=75313278ff3747909a57b6f37496d31e, user.id=733839729aa249e0823f24a8e8fb3ffe) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:40.641469 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7610a-a6a2-4b67-bea7-a26b16bfa8a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:40.642902 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7610a-a6a2-4b67-bea7-a26b16bfa8a0 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:40.645028 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:40.663126 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 445/867] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:15:40 2022] GET /identity/v3/role_assignments?user.id=733839729aa249e0823f24a8e8fb3ffe&scope.project.id=75313278ff3747909a57b6f37496d31e&role.id=49069056c7b14e319599004c4af25dfb => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:43.217161 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c18c1-6f9a-4556-acfc-ebe014a72314 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:43.217723 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c18c1-6f9a-4556-acfc-ebe014a72314 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:43.217723 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c18c1-6f9a-4556-acfc-ebe014a72314 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:43.219030 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 423/868] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:15:43.229418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e55279-8687-46dc-94b9-9dff2e3e8b47 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:43.229418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e55279-8687-46dc-94b9-9dff2e3e8b47 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:43.229418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e55279-8687-46dc-94b9-9dff2e3e8b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:43.250050 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-d4e55279-8687-46dc-94b9-9dff2e3e8b47 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:15:43.251348 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-d4e55279-8687-46dc-94b9-9dff2e3e8b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:15:43.326727 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 446/869] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:15:43 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:15:43.364090 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c18c1-6f9a-4556-acfc-ebe014a72314 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:43.387691 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:43.486143 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c18c1-6f9a-4556-acfc-ebe014a72314 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:43.521954 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7d6ad-f20c-4b69-9058-f86f06477b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:43.522598 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7d6ad-f20c-4b69-9058-f86f06477b99 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:43.522879 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7d6ad-f20c-4b69-9058-f86f06477b99 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:43.523184 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7d6ad-f20c-4b69-9058-f86f06477b99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:43.534527 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7d6ad-f20c-4b69-9058-f86f06477b99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:15:43.540386 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-edf7d6ad-f20c-4b69-9058-f86f06477b99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:15:43.540386 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:43.540386 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:43.540386 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:43.540386 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:43.540386 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:43.540386 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:43.540386 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:43.540386 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:43.540386 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:43.540386 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:43.540386 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:43.540386 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:15:43.540386 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:15:43.540386 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:15:43.540386 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:15:43.541452 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:15:43.541452 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:15:43.541452 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:15:43.541452 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:15:43.541452 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:43.541452 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:43.541452 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:43.541452 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:43.541452 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:43.541452 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:43.541452 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:43.541452 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:43.541452 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:43.541452 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:43.541452 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:43.541452 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:43.542277 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:43.542277 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:43.542277 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:43.542277 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:43.542277 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:15:43.542277 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:15:43.542277 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:15:43.542277 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:15:43.542277 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:15:43.542277 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:15:43.542277 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:15:43.542277 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:15:43.542277 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 424/870] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 27 20:15:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:43.547782 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e55279-8687-46dc-94b9-9dff2e3e8b47 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:43.661696 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e55279-8687-46dc-94b9-9dff2e3e8b47 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:43.692749 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:43.704573 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408d9c3-f6b3-4f63-a000-e3ea5fa6cbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:43.705327 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408d9c3-f6b3-4f63-a000-e3ea5fa6cbb2 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:43.705609 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408d9c3-f6b3-4f63-a000-e3ea5fa6cbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:43.705880 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408d9c3-f6b3-4f63-a000-e3ea5fa6cbb2 None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:43.706604 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408d9c3-f6b3-4f63-a000-e3ea5fa6cbb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:43.706912 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408d9c3-f6b3-4f63-a000-e3ea5fa6cbb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:43.708435 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408d9c3-f6b3-4f63-a000-e3ea5fa6cbb2 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:43.719975 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 447/871] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:15:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:43.723740 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7d6ad-f20c-4b69-9058-f86f06477b99 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:43.808350 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:43.835632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7d6ad-f20c-4b69-9058-f86f06477b99 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:43.874824 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce612d0-a62b-4640-a461-ae4923ecd1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:43.875602 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce612d0-a62b-4640-a461-ae4923ecd1db None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:43.875781 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce612d0-a62b-4640-a461-ae4923ecd1db None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:43.876032 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce612d0-a62b-4640-a461-ae4923ecd1db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:43.886054 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce612d0-a62b-4640-a461-ae4923ecd1db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:43.888093 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce612d0-a62b-4640-a461-ae4923ecd1db None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:43.902903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-4ce612d0-a62b-4640-a461-ae4923ecd1db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:15:43.902903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:43.902903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:43.902903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:43.902903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:43.902903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:43.902903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:43.902903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:43.902903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:43.902903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:43.902903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:43.902903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:43.902903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:15:43.902903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:15:43.902903 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:15:43.904075 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:15:43.904075 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:43.904075 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:43.904075 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:43.904075 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:43.904075 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:43.904075 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:43.904075 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:43.904075 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:43.904075 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:43.904075 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:43.904075 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:43.904075 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:43.904075 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:43.904075 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:43.904075 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:43.904075 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:43.905252 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:15:43.905252 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:15:43.905252 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:15:43.905252 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:15:43.905252 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 425/872] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:15:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:43.910300 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408d9c3-f6b3-4f63-a000-e3ea5fa6cbb2 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:44.032422 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408d9c3-f6b3-4f63-a000-e3ea5fa6cbb2 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:44.075755 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46898f0d-73ef-41b7-8652-4b34bb338aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:44.076304 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46898f0d-73ef-41b7-8652-4b34bb338aeb None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:44.076578 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46898f0d-73ef-41b7-8652-4b34bb338aeb None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:44.076853 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46898f0d-73ef-41b7-8652-4b34bb338aeb None admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:44.077548 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46898f0d-73ef-41b7-8652-4b34bb338aeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:44.077846 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46898f0d-73ef-41b7-8652-4b34bb338aeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:44.079600 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46898f0d-73ef-41b7-8652-4b34bb338aeb None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:44.095107 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 448/873] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:44.099432 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce612d0-a62b-4640-a461-ae4923ecd1db None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:44.217361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce612d0-a62b-4640-a461-ae4923ecd1db None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:44.251131 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:44.260104 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9cdcb6-cc10-4d23-b16a-8880cf3b9d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:44.260853 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cdcb6-cc10-4d23-b16a-8880cf3b9d67 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:44.261117 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cdcb6-cc10-4d23-b16a-8880cf3b9d67 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:44.261416 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cdcb6-cc10-4d23-b16a-8880cf3b9d67 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:44.269489 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9cdcb6-cc10-4d23-b16a-8880cf3b9d67 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:44.271049 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9cdcb6-cc10-4d23-b16a-8880cf3b9d67 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:44.285020 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-ef9cdcb6-cc10-4d23-b16a-8880cf3b9d67 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 20:15:44.285020 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:44.285020 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:44.285020 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:44.285020 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:44.285020 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:44.285020 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:44.285020 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:44.285020 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:44.285020 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:44.285020 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:44.285020 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:44.285020 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 20:15:44.285020 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 20:15:44.285020 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 20:15:44.285020 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 20:15:44.286228 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:44.286228 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:44.286228 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 20:15:44.286228 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:15:44.286228 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 20:15:44.286228 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:15:44.286228 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:44.286228 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:44.286228 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:44.286228 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:44.286228 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:44.286228 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:44.286228 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:44.286228 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:44.286228 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:44.286228 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:44.286228 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:44.286228 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:44.288156 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:44.288156 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:44.288156 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 20:15:44.288156 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 20:15:44.288156 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 20:15:44.288156 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 20:15:44.288156 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 20:15:44.288156 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 20:15:44.288156 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 20:15:44.288156 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:15:44.288156 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 426/874] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:15:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:44.292415 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46898f0d-73ef-41b7-8652-4b34bb338aeb None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:44.361540 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:44.422288 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46898f0d-73ef-41b7-8652-4b34bb338aeb None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:44.465883 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d22e37-d64a-4578-857b-acefb7dd3541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:44.466546 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d22e37-d64a-4578-857b-acefb7dd3541 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:44.466821 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d22e37-d64a-4578-857b-acefb7dd3541 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:44.467131 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d22e37-d64a-4578-857b-acefb7dd3541 None admin] PATH_INFO: `/v3/users` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:44.467940 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d22e37-d64a-4578-857b-acefb7dd3541 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:44.468244 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d22e37-d64a-4578-857b-acefb7dd3541 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:44.469688 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d22e37-d64a-4578-857b-acefb7dd3541 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:44.491749 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 449/875] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Jul 27 20:15:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:44.498221 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9cdcb6-cc10-4d23-b16a-8880cf3b9d67 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:44.602772 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9cdcb6-cc10-4d23-b16a-8880cf3b9d67 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:44.638773 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f5b49-b8c7-40c9-beaf-1eed9978c8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:44.639354 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f5b49-b8c7-40c9-beaf-1eed9978c8bb None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:44.639635 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f5b49-b8c7-40c9-beaf-1eed9978c8bb None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:44.639905 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f5b49-b8c7-40c9-beaf-1eed9978c8bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:44.698788 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:44.719553 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f5b49-b8c7-40c9-beaf-1eed9978c8bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:44.721074 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f5b49-b8c7-40c9-beaf-1eed9978c8bb None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:44.829639 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 427/876] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:15:44 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 20:15:44.830937 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d22e37-d64a-4578-857b-acefb7dd3541 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:44.936960 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d22e37-d64a-4578-857b-acefb7dd3541 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:44.948176 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:44.986226 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4f1df-f53b-4fb8-a131-30d47275b566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:44.986877 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4f1df-f53b-4fb8-a131-30d47275b566 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:44.987190 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4f1df-f53b-4fb8-a131-30d47275b566 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:44.987466 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4f1df-f53b-4fb8-a131-30d47275b566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:44.999737 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4f1df-f53b-4fb8-a131-30d47275b566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:45.001221 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4f1df-f53b-4fb8-a131-30d47275b566 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:45.016389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-32a4f1df-f53b-4fb8-a131-30d47275b566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:15:45.016389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:45.016389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:45.016389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:45.016389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:45.016389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:45.016389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:45.016389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:45.016389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:45.016389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:45.016389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:45.016389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:45.016389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:15:45.016389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:15:45.016389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:15:45.017482 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:15:45.017482 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:45.017482 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:45.017482 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:45.017482 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:45.017482 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:45.017482 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:45.017482 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:45.017482 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:45.017482 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:45.017482 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:45.017482 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:45.017482 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:45.017482 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:45.017482 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:45.017482 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:45.017482 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:45.018432 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:15:45.018432 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:15:45.018432 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:15:45.018432 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:15:45.018432 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 450/877] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:15:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:45.023437 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f5b49-b8c7-40c9-beaf-1eed9978c8bb None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:45.111463 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:45.124313 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f5b49-b8c7-40c9-beaf-1eed9978c8bb None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:45.157920 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9ab34-6d22-46fd-ac09-e7b899a3e607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:45.158539 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9ab34-6d22-46fd-ac09-e7b899a3e607 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:45.158822 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9ab34-6d22-46fd-ac09-e7b899a3e607 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:45.159123 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9ab34-6d22-46fd-ac09-e7b899a3e607 None admin] PATH_INFO: `/v3/domains` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:45.159805 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9ab34-6d22-46fd-ac09-e7b899a3e607 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:45.160111 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9ab34-6d22-46fd-ac09-e7b899a3e607 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:45.161495 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9ab34-6d22-46fd-ac09-e7b899a3e607 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:45.172377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 428/878] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:15:45.178066 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4f1df-f53b-4fb8-a131-30d47275b566 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:45.276196 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4f1df-f53b-4fb8-a131-30d47275b566 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:45.308042 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed15727-9bcf-4322-8a2d-7bf7f08e2ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:45.309631 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed15727-9bcf-4322-8a2d-7bf7f08e2ad8 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:45.309920 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed15727-9bcf-4322-8a2d-7bf7f08e2ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:45.310189 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed15727-9bcf-4322-8a2d-7bf7f08e2ad8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:45.317833 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed15727-9bcf-4322-8a2d-7bf7f08e2ad8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:45.319310 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed15727-9bcf-4322-8a2d-7bf7f08e2ad8 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:45.331060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-aed15727-9bcf-4322-8a2d-7bf7f08e2ad8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:15:45.331060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:45.331060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:45.331060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:45.331060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:45.331060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:45.331060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:45.331060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:45.331060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:45.331060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:45.331060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:45.331060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:45.331060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 20:15:45.331060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 20:15:45.331060 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 20:15:45.332126 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 20:15:45.332126 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:45.332126 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:45.332126 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:45.332126 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:45.332126 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:45.332126 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:45.332126 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:45.332126 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:45.332126 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:45.332126 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:45.332126 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:45.332126 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:45.332126 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:45.332126 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:45.332126 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:45.332126 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:45.333222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 20:15:45.333222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 20:15:45.333222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 20:15:45.333222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 20:15:45.333222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 20:15:45.333222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 20:15:45.333222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:15:45.333222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:15:45.333222 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 451/879] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:15:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:45.338189 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9ab34-6d22-46fd-ac09-e7b899a3e607 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:45.435378 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9ab34-6d22-46fd-ac09-e7b899a3e607 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:45.467681 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae62612-7676-4555-8283-961bb0ffdb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:45.468284 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae62612-7676-4555-8283-961bb0ffdb68 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:45.468560 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae62612-7676-4555-8283-961bb0ffdb68 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:45.468830 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae62612-7676-4555-8283-961bb0ffdb68 None admin] PATH_INFO: `/v3/projects` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:45.469562 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae62612-7676-4555-8283-961bb0ffdb68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:45.469868 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae62612-7676-4555-8283-961bb0ffdb68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:45.471313 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae62612-7676-4555-8283-961bb0ffdb68 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:45.482885 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 429/880] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 27 20:15:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:45.488839 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed15727-9bcf-4322-8a2d-7bf7f08e2ad8 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:45.510691 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:45.583897 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed15727-9bcf-4322-8a2d-7bf7f08e2ad8 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:45.615322 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e95d93-cb44-4bb9-97ef-458107a54ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:45.615907 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e95d93-cb44-4bb9-97ef-458107a54ed3 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:45.616184 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e95d93-cb44-4bb9-97ef-458107a54ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:45.616452 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e95d93-cb44-4bb9-97ef-458107a54ed3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:45.617211 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e95d93-cb44-4bb9-97ef-458107a54ed3 None admin] RBAC: Adding query filter params (role.id=df8ec36d044b469d8854eba8394eb107, scope.project.id=75313278ff3747909a57b6f37496d31e, user.id=733839729aa249e0823f24a8e8fb3ffe) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:45.617514 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e95d93-cb44-4bb9-97ef-458107a54ed3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:45.618914 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e95d93-cb44-4bb9-97ef-458107a54ed3 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:45.624949 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 452/881] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:15:45 2022] GET /identity/v3/role_assignments?user.id=733839729aa249e0823f24a8e8fb3ffe&scope.project.id=75313278ff3747909a57b6f37496d31e&role.id=df8ec36d044b469d8854eba8394eb107 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:47.776415 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721eb64-4401-49fe-9315-0929120c08e5 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:47.776987 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721eb64-4401-49fe-9315-0929120c08e5 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:47.776987 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721eb64-4401-49fe-9315-0929120c08e5 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:47.778804 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 430/882] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:15:47.783886 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21857309-f71b-42f1-8399-dd1df6c6f6e2 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:47.784318 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21857309-f71b-42f1-8399-dd1df6c6f6e2 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:47.784417 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21857309-f71b-42f1-8399-dd1df6c6f6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:47.802559 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-21857309-f71b-42f1-8399-dd1df6c6f6e2 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:15:47.803774 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-21857309-f71b-42f1-8399-dd1df6c6f6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:15:47.867590 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 453/883] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:15:47 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:15:47.891781 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721eb64-4401-49fe-9315-0929120c08e5 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:47.902372 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:48.007847 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721eb64-4401-49fe-9315-0929120c08e5 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:48.042993 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f4245-55d3-4510-8d79-09d69f54a9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:48.043600 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f4245-55d3-4510-8d79-09d69f54a9ce None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:48.043885 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f4245-55d3-4510-8d79-09d69f54a9ce None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:48.044159 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f4245-55d3-4510-8d79-09d69f54a9ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:48.053864 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f4245-55d3-4510-8d79-09d69f54a9ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:15:48.058761 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-916f4245-55d3-4510-8d79-09d69f54a9ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:15:48.058761 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:48.058761 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:48.058761 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:48.058761 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:48.058761 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:48.058761 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:48.058761 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:48.058761 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:48.058761 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:48.058761 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:48.058761 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:48.058761 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:15:48.058761 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:15:48.058761 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:15:48.058761 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:15:48.059921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:15:48.059921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:15:48.059921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:15:48.059921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:15:48.059921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:48.059921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:48.059921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:48.059921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:48.059921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:48.059921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:48.059921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:48.059921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:48.059921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:48.059921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:48.059921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:48.059921 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:48.060884 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:48.060884 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:48.060884 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:48.060884 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:48.060884 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:15:48.060884 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:15:48.060884 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:15:48.060884 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:15:48.060884 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:15:48.060884 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:15:48.060884 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:15:48.060884 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:15:48.060884 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 431/884] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 27 20:15:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:48.065896 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21857309-f71b-42f1-8399-dd1df6c6f6e2 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:48.082177 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:48.162976 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21857309-f71b-42f1-8399-dd1df6c6f6e2 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:48.195251 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57544e5-9b23-4295-ac57-9ee6bf9c5727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:48.195855 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57544e5-9b23-4295-ac57-9ee6bf9c5727 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:48.196135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57544e5-9b23-4295-ac57-9ee6bf9c5727 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:48.196410 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57544e5-9b23-4295-ac57-9ee6bf9c5727 None admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:48.197114 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57544e5-9b23-4295-ac57-9ee6bf9c5727 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:48.197418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57544e5-9b23-4295-ac57-9ee6bf9c5727 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:48.198777 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57544e5-9b23-4295-ac57-9ee6bf9c5727 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:48.207043 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 454/885] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:15:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:48.212800 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f4245-55d3-4510-8d79-09d69f54a9ce None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:48.284336 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:48.319639 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f4245-55d3-4510-8d79-09d69f54a9ce None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:48.353487 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71d3f5-2084-4afa-b057-51b2e293bb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:48.354124 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71d3f5-2084-4afa-b057-51b2e293bb46 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:48.354406 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71d3f5-2084-4afa-b057-51b2e293bb46 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:48.354681 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71d3f5-2084-4afa-b057-51b2e293bb46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:48.364352 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71d3f5-2084-4afa-b057-51b2e293bb46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:48.365785 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71d3f5-2084-4afa-b057-51b2e293bb46 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:48.380739 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-aa71d3f5-2084-4afa-b057-51b2e293bb46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:15:48.380739 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:48.380739 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:48.380739 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:48.380739 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:48.380739 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:48.380739 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:48.380739 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:48.380739 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:48.380739 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:48.380739 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:48.380739 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:48.380739 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:15:48.380739 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:15:48.380739 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:15:48.381765 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:15:48.381765 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:48.381765 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:48.381765 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:48.381765 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:48.381765 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:48.381765 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:48.381765 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:48.381765 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:48.381765 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:48.381765 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:48.381765 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:48.381765 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:48.381765 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:48.381765 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:48.381765 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:48.381765 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:48.382923 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:15:48.382923 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:15:48.382923 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:15:48.382923 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:15:48.382923 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 432/886] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:48.388257 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57544e5-9b23-4295-ac57-9ee6bf9c5727 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:48.461093 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:48.482813 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57544e5-9b23-4295-ac57-9ee6bf9c5727 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:48.515424 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba522dc1-9a07-42f7-a801-4fae290b4481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:48.516024 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba522dc1-9a07-42f7-a801-4fae290b4481 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:48.516299 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba522dc1-9a07-42f7-a801-4fae290b4481 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:48.516567 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba522dc1-9a07-42f7-a801-4fae290b4481 None admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:48.517235 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba522dc1-9a07-42f7-a801-4fae290b4481 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:48.517534 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba522dc1-9a07-42f7-a801-4fae290b4481 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:48.518884 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba522dc1-9a07-42f7-a801-4fae290b4481 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:48.530337 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 455/887] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:48.535962 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71d3f5-2084-4afa-b057-51b2e293bb46 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:48.633535 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71d3f5-2084-4afa-b057-51b2e293bb46 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:48.652162 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:48.666109 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f240d-e89e-4972-8ab6-25d6b313544e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:48.666740 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f240d-e89e-4972-8ab6-25d6b313544e None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:48.667021 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f240d-e89e-4972-8ab6-25d6b313544e None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:48.667328 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f240d-e89e-4972-8ab6-25d6b313544e None admin] PATH_INFO: `/v3/users/placement` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:48.674966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f240d-e89e-4972-8ab6-25d6b313544e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:48.676444 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f240d-e89e-4972-8ab6-25d6b313544e None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:48.687941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-f93f240d-e89e-4972-8ab6-25d6b313544e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 20:15:48.687941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:48.687941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:48.687941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:48.687941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:48.687941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:48.687941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:48.687941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:48.687941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:48.687941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:48.687941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:48.687941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:48.687941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 20:15:48.687941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 20:15:48.687941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 20:15:48.687941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 20:15:48.689067 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:48.689067 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:48.689067 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 20:15:48.689067 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:15:48.689067 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 20:15:48.689067 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:15:48.689067 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:48.689067 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:48.689067 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:48.689067 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:48.689067 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:48.689067 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:48.689067 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:48.689067 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:48.689067 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:48.689067 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:48.689067 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:48.689067 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:48.690220 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:48.690220 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:48.690220 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 20:15:48.690220 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 20:15:48.690220 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 20:15:48.690220 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 20:15:48.690220 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 20:15:48.690220 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 20:15:48.690220 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 20:15:48.690220 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:15:48.690220 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 433/888] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:15:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:48.694723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba522dc1-9a07-42f7-a801-4fae290b4481 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:48.789963 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba522dc1-9a07-42f7-a801-4fae290b4481 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:48.822909 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d28af-1b33-4f69-8efc-53be12327449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:48.823547 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d28af-1b33-4f69-8efc-53be12327449 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:48.823829 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d28af-1b33-4f69-8efc-53be12327449 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:48.824104 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d28af-1b33-4f69-8efc-53be12327449 None admin] PATH_INFO: `/v3/users` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:48.824932 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d28af-1b33-4f69-8efc-53be12327449 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:48.825238 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d28af-1b33-4f69-8efc-53be12327449 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:48.826652 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d28af-1b33-4f69-8efc-53be12327449 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:48.829136 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:48.843255 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 456/889] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Jul 27 20:15:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:48.848844 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f240d-e89e-4972-8ab6-25d6b313544e None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:48.956272 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f240d-e89e-4972-8ab6-25d6b313544e None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:48.992835 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5b7ea-ffd3-44fe-b150-4417da736ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:48.993461 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5b7ea-ffd3-44fe-b150-4417da736ff7 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:48.993738 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5b7ea-ffd3-44fe-b150-4417da736ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:48.994006 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5b7ea-ffd3-44fe-b150-4417da736ff7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:49.004307 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5b7ea-ffd3-44fe-b150-4417da736ff7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:49.005729 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5b7ea-ffd3-44fe-b150-4417da736ff7 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:49.019256 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-46c5b7ea-ffd3-44fe-b150-4417da736ff7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:15:49.019256 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:49.019256 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:49.019256 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:49.019256 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:49.019256 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:49.019256 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:49.019256 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:49.019256 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:49.019256 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:49.019256 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:49.019256 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:49.019256 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:15:49.019256 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:15:49.019256 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:15:49.020269 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:15:49.020269 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:49.020269 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:49.020269 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:49.020269 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:49.020269 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:49.020269 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:49.020269 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:49.020269 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:49.020269 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:49.020269 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:49.020269 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:49.020269 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:49.020269 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:49.020269 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:49.020269 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:49.020269 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:49.021200 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:15:49.021200 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:15:49.021200 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:15:49.021200 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:15:49.021200 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 434/890] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:49.026121 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d28af-1b33-4f69-8efc-53be12327449 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:49.122070 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d28af-1b33-4f69-8efc-53be12327449 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:49.155343 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba8cd7-2a31-42ce-acde-935e8ecebc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:49.155945 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba8cd7-2a31-42ce-acde-935e8ecebc77 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:49.156227 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba8cd7-2a31-42ce-acde-935e8ecebc77 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:49.156504 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba8cd7-2a31-42ce-acde-935e8ecebc77 None admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:49.157182 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba8cd7-2a31-42ce-acde-935e8ecebc77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:49.157488 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba8cd7-2a31-42ce-acde-935e8ecebc77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:49.158846 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba8cd7-2a31-42ce-acde-935e8ecebc77 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:49.170129 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 457/891] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:49.175594 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5b7ea-ffd3-44fe-b150-4417da736ff7 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:49.205899 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:49.272187 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5b7ea-ffd3-44fe-b150-4417da736ff7 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:49.304946 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c59908-ce26-4d65-9288-eafccc68bde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:49.305579 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c59908-ce26-4d65-9288-eafccc68bde7 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:49.305862 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c59908-ce26-4d65-9288-eafccc68bde7 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:49.306136 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c59908-ce26-4d65-9288-eafccc68bde7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:49.312700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c59908-ce26-4d65-9288-eafccc68bde7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:49.314145 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c59908-ce26-4d65-9288-eafccc68bde7 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:49.325776 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-a9c59908-ce26-4d65-9288-eafccc68bde7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:15:49.325776 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:49.325776 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:49.325776 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:49.325776 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:49.325776 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:49.325776 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:49.325776 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:49.325776 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:49.325776 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:49.325776 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:49.325776 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:49.325776 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 20:15:49.325776 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 20:15:49.325776 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 20:15:49.326708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 20:15:49.326708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:49.326708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:49.326708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:49.326708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:49.326708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:49.326708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:49.326708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:49.326708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:49.326708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:49.326708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:49.326708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:49.326708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:49.326708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:49.326708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:49.326708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:49.326708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:49.327728 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 20:15:49.327728 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 20:15:49.327728 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 20:15:49.327728 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 20:15:49.327728 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 20:15:49.327728 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 20:15:49.327728 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:15:49.327728 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:15:49.327728 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 435/892] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:15:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:49.332952 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba8cd7-2a31-42ce-acde-935e8ecebc77 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:49.387757 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:49.430288 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba8cd7-2a31-42ce-acde-935e8ecebc77 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:49.462087 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316246c-8d27-48ea-807c-330aa1b7706d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:49.462687 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316246c-8d27-48ea-807c-330aa1b7706d None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:49.462966 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316246c-8d27-48ea-807c-330aa1b7706d None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:49.463269 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316246c-8d27-48ea-807c-330aa1b7706d None admin] PATH_INFO: `/v3/projects` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:49.464000 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316246c-8d27-48ea-807c-330aa1b7706d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:49.464305 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316246c-8d27-48ea-807c-330aa1b7706d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:49.466307 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316246c-8d27-48ea-807c-330aa1b7706d None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:49.477668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 458/893] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 27 20:15:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:49.483994 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c59908-ce26-4d65-9288-eafccc68bde7 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:49.573951 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:49.583545 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c59908-ce26-4d65-9288-eafccc68bde7 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:49.616126 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de2dd8-3752-4bb0-bc77-1fa350fd28ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:49.616776 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de2dd8-3752-4bb0-bc77-1fa350fd28ba None admin] REQUEST_METHOD: `PUT` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:49.617054 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de2dd8-3752-4bb0-bc77-1fa350fd28ba None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:49.617324 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de2dd8-3752-4bb0-bc77-1fa350fd28ba None admin] PATH_INFO: `/v3/projects/75313278ff3747909a57b6f37496d31e/users/733839729aa249e0823f24a8e8fb3ffe/roles/df8ec36d044b469d8854eba8394eb107` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:49.619257 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de2dd8-3752-4bb0-bc77-1fa350fd28ba None admin] RBAC: Authorizing `identity:create_grant(project_id=75313278ff3747909a57b6f37496d31e, user_id=733839729aa249e0823f24a8e8fb3ffe, role_id=df8ec36d044b469d8854eba8394eb107)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:49.620949 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de2dd8-3752-4bb0-bc77-1fa350fd28ba None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:49.633252 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 436/894] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 27 20:15:49 2022] PUT /identity/v3/projects/75313278ff3747909a57b6f37496d31e/users/733839729aa249e0823f24a8e8fb3ffe/roles/df8ec36d044b469d8854eba8394eb107 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:15:51.814228 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198ba97-7634-4ef4-ab63-c00dbb8886af None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:51.814754 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198ba97-7634-4ef4-ab63-c00dbb8886af None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:51.814754 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198ba97-7634-4ef4-ab63-c00dbb8886af None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:51.816162 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 459/895] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:15:51.821437 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039d88d-fef0-4f74-874f-56d971da91c8 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:51.821843 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039d88d-fef0-4f74-874f-56d971da91c8 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:51.821992 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039d88d-fef0-4f74-874f-56d971da91c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:51.839592 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-9039d88d-fef0-4f74-874f-56d971da91c8 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:15:51.840779 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-9039d88d-fef0-4f74-874f-56d971da91c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:15:51.904493 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 437/896] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:15:51 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:15:51.930121 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198ba97-7634-4ef4-ab63-c00dbb8886af None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:52.047054 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198ba97-7634-4ef4-ab63-c00dbb8886af None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:52.060320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:52.079616 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d721db9-1085-48c0-8f56-476e07f28925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:52.080193 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d721db9-1085-48c0-8f56-476e07f28925 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:52.080477 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d721db9-1085-48c0-8f56-476e07f28925 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:52.080755 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d721db9-1085-48c0-8f56-476e07f28925 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:52.090869 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d721db9-1085-48c0-8f56-476e07f28925 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 20:15:52.097141 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-2d721db9-1085-48c0-8f56-476e07f28925 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:15:52.097141 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:52.097141 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:52.097141 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:52.097141 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:52.097141 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:52.097141 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:52.097141 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:52.097141 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:52.097141 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:52.097141 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:52.097141 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:52.097141 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 20:15:52.097141 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 20:15:52.097141 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 20:15:52.097141 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 20:15:52.098219 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 20:15:52.098219 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 20:15:52.098219 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 20:15:52.098219 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 20:15:52.098219 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:52.098219 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:52.098219 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:52.098219 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:52.098219 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:52.098219 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:52.098219 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:52.098219 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:52.098219 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:52.098219 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:52.098219 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:52.098219 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:52.099132 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:52.099132 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:52.099132 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:52.099132 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:52.099132 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 20:15:52.099132 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 20:15:52.099132 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 20:15:52.099132 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 20:15:52.099132 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 20:15:52.099132 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 20:15:52.099132 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 20:15:52.099132 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:15:52.099132 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 460/897] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 27 20:15:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:52.105060 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039d88d-fef0-4f74-874f-56d971da91c8 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:52.188747 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:52.207191 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039d88d-fef0-4f74-874f-56d971da91c8 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:52.240370 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766de95f-78ae-443b-a976-1cf460fe6a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:52.240984 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766de95f-78ae-443b-a976-1cf460fe6a71 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:52.241267 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766de95f-78ae-443b-a976-1cf460fe6a71 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:52.241542 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766de95f-78ae-443b-a976-1cf460fe6a71 None admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:52.242250 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766de95f-78ae-443b-a976-1cf460fe6a71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:52.242556 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766de95f-78ae-443b-a976-1cf460fe6a71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:52.243941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766de95f-78ae-443b-a976-1cf460fe6a71 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:52.251982 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 438/898] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 27 20:15:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:52.257797 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d721db9-1085-48c0-8f56-476e07f28925 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:52.355034 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d721db9-1085-48c0-8f56-476e07f28925 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:52.390948 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a831e1f-1785-4095-93d8-15bfca0fea49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:52.391610 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a831e1f-1785-4095-93d8-15bfca0fea49 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:52.391888 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a831e1f-1785-4095-93d8-15bfca0fea49 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:52.392159 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a831e1f-1785-4095-93d8-15bfca0fea49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:52.401948 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a831e1f-1785-4095-93d8-15bfca0fea49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:52.404022 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a831e1f-1785-4095-93d8-15bfca0fea49 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:52.418106 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-2a831e1f-1785-4095-93d8-15bfca0fea49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:15:52.418106 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:52.418106 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:52.418106 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:52.418106 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:52.418106 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:52.418106 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:52.418106 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:52.418106 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:52.418106 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:52.418106 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:52.418106 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:52.418106 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:15:52.418106 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:15:52.418106 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:15:52.419206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:15:52.419206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:52.419206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:52.419206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:52.419206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:52.419206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:52.419206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:52.419206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:52.419206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:52.419206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:52.419206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:52.419206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:52.419206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:52.419206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:52.419206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:52.419206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:52.419206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:52.420261 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:15:52.420261 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:15:52.420261 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:15:52.420261 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:15:52.420261 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 461/899] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:15:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:52.424969 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766de95f-78ae-443b-a976-1cf460fe6a71 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:52.528711 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766de95f-78ae-443b-a976-1cf460fe6a71 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:52.560229 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2e6bc-38ac-4999-a762-f1b174ac90f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:52.560837 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2e6bc-38ac-4999-a762-f1b174ac90f4 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:52.561117 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2e6bc-38ac-4999-a762-f1b174ac90f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:52.561386 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2e6bc-38ac-4999-a762-f1b174ac90f4 None admin] PATH_INFO: `/v3/domains` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:52.562063 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2e6bc-38ac-4999-a762-f1b174ac90f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:52.562365 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2e6bc-38ac-4999-a762-f1b174ac90f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:52.563737 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2e6bc-38ac-4999-a762-f1b174ac90f4 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:52.575507 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 439/900] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:52.581228 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a831e1f-1785-4095-93d8-15bfca0fea49 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:52.608470 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:52.677754 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a831e1f-1785-4095-93d8-15bfca0fea49 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:52.710636 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cbbff-4b1e-4b29-951f-8c4304ca8767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:52.711294 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cbbff-4b1e-4b29-951f-8c4304ca8767 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:52.711577 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cbbff-4b1e-4b29-951f-8c4304ca8767 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:52.711849 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cbbff-4b1e-4b29-951f-8c4304ca8767 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:52.718950 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446cbbff-4b1e-4b29-951f-8c4304ca8767 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:52.720406 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446cbbff-4b1e-4b29-951f-8c4304ca8767 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:52.731294 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-446cbbff-4b1e-4b29-951f-8c4304ca8767 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 20:15:52.731294 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:52.731294 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:52.731294 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:52.731294 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:52.731294 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:52.731294 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:52.731294 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:52.731294 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:52.731294 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:52.731294 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:52.731294 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:52.731294 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 20:15:52.731294 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 20:15:52.731294 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 20:15:52.731294 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 20:15:52.732389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:52.732389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:52.732389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 20:15:52.732389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:15:52.732389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 20:15:52.732389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 20:15:52.732389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:52.732389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:52.732389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:52.732389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:52.732389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:52.732389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:52.732389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:52.732389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:52.732389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:52.732389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:52.732389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:52.732389 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:52.733521 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:52.733521 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:52.733521 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 20:15:52.733521 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 20:15:52.733521 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 20:15:52.733521 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 20:15:52.733521 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 20:15:52.733521 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 20:15:52.733521 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 20:15:52.733521 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:15:52.733521 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 462/901] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:15:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:52.738298 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2e6bc-38ac-4999-a762-f1b174ac90f4 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:52.742018 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:52.837515 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2e6bc-38ac-4999-a762-f1b174ac90f4 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:52.869447 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165416e0-417a-4ffa-9a94-6c90683ac5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:52.869982 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165416e0-417a-4ffa-9a94-6c90683ac5fe None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:52.870525 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165416e0-417a-4ffa-9a94-6c90683ac5fe None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:52.870793 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165416e0-417a-4ffa-9a94-6c90683ac5fe None admin] PATH_INFO: `/v3/users` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:52.872604 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165416e0-417a-4ffa-9a94-6c90683ac5fe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:52.872914 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165416e0-417a-4ffa-9a94-6c90683ac5fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:52.874839 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165416e0-417a-4ffa-9a94-6c90683ac5fe None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:52.892327 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 440/902] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Jul 27 20:15:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:52.898080 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cbbff-4b1e-4b29-951f-8c4304ca8767 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:52.983842 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:52.999260 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cbbff-4b1e-4b29-951f-8c4304ca8767 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:53.031484 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc400c-2d77-43d6-b268-c1618807ec07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:53.032091 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc400c-2d77-43d6-b268-c1618807ec07 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:53.032374 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc400c-2d77-43d6-b268-c1618807ec07 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:53.032649 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc400c-2d77-43d6-b268-c1618807ec07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:53.101665 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc400c-2d77-43d6-b268-c1618807ec07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:53.103206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc400c-2d77-43d6-b268-c1618807ec07 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:53.183421 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:53.199045 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 463/903] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 27 20:15:52 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 20:15:53.204987 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165416e0-417a-4ffa-9a94-6c90683ac5fe None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:53.265139 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:53.302125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165416e0-417a-4ffa-9a94-6c90683ac5fe None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:53.334958 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8207881-4dd8-454e-961d-7d21d5204f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:53.335617 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8207881-4dd8-454e-961d-7d21d5204f0d None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:53.335898 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8207881-4dd8-454e-961d-7d21d5204f0d None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:53.336169 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8207881-4dd8-454e-961d-7d21d5204f0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:53.345715 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8207881-4dd8-454e-961d-7d21d5204f0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:53.347180 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8207881-4dd8-454e-961d-7d21d5204f0d None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:53.361764 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-e8207881-4dd8-454e-961d-7d21d5204f0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:15:53.361764 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:53.361764 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:53.361764 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:53.361764 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:53.361764 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:53.361764 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:53.361764 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:53.361764 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:53.361764 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:53.361764 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:53.361764 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:53.361764 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 20:15:53.361764 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 20:15:53.361764 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 20:15:53.362819 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 20:15:53.362819 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:53.362819 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:53.362819 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:53.362819 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:53.362819 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:53.362819 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:53.362819 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:53.362819 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:53.362819 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:53.362819 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:53.362819 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:53.362819 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:53.362819 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:53.362819 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:53.362819 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:53.362819 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:53.363943 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 20:15:53.363943 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 20:15:53.363943 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 20:15:53.363943 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:15:53.363943 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 441/904] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:53.369288 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc400c-2d77-43d6-b268-c1618807ec07 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:53.463367 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc400c-2d77-43d6-b268-c1618807ec07 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:53.496502 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadeaad-bc21-4e6e-aed7-5552fc8c5392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:53.497102 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadeaad-bc21-4e6e-aed7-5552fc8c5392 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:53.497381 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadeaad-bc21-4e6e-aed7-5552fc8c5392 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:53.497652 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadeaad-bc21-4e6e-aed7-5552fc8c5392 None admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:53.498319 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadeaad-bc21-4e6e-aed7-5552fc8c5392 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:53.498620 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadeaad-bc21-4e6e-aed7-5552fc8c5392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:53.499984 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadeaad-bc21-4e6e-aed7-5552fc8c5392 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:53.510625 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 464/905] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 27 20:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:53.516092 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8207881-4dd8-454e-961d-7d21d5204f0d None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:53.612360 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8207881-4dd8-454e-961d-7d21d5204f0d None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:53.625752 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:53.645222 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c8d53-b427-4ef2-b412-a268039a79e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:53.645848 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c8d53-b427-4ef2-b412-a268039a79e2 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:53.646128 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c8d53-b427-4ef2-b412-a268039a79e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:53.646398 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c8d53-b427-4ef2-b412-a268039a79e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:53.653280 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c8d53-b427-4ef2-b412-a268039a79e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:53.654704 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c8d53-b427-4ef2-b412-a268039a79e2 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:53.665696 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application [None req-0d1c8d53-b427-4ef2-b412-a268039a79e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:15:53.665696 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:53.665696 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:53.665696 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:53.665696 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:53.665696 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:53.665696 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:53.665696 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:53.665696 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:53.665696 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:53.665696 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:53.665696 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:53.665696 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 20:15:53.665696 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 20:15:53.665696 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 20:15:53.666726 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 20:15:53.666726 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:53.666726 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:53.666726 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:53.666726 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:53.666726 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:53.666726 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:53.666726 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:53.666726 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:53.666726 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:53.666726 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:53.666726 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:53.666726 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:53.666726 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:53.666726 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:53.666726 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:53.666726 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:53.667904 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 20:15:53.667904 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 20:15:53.667904 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 20:15:53.667904 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 20:15:53.667904 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 20:15:53.667904 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 20:15:53.667904 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 20:15:53.667904 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: ERROR keystone.server.flask.application Jul 27 20:15:53.667904 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 442/906] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 27 20:15:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 20:15:53.673250 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadeaad-bc21-4e6e-aed7-5552fc8c5392 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:53.718673 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:53.770016 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadeaad-bc21-4e6e-aed7-5552fc8c5392 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:53.805858 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688f7ee-6288-4808-9582-b14c6e3af47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:53.806461 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688f7ee-6288-4808-9582-b14c6e3af47d None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:53.806743 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688f7ee-6288-4808-9582-b14c6e3af47d None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:53.807015 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688f7ee-6288-4808-9582-b14c6e3af47d None admin] PATH_INFO: `/v3/projects` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:53.807785 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688f7ee-6288-4808-9582-b14c6e3af47d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:53.808091 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688f7ee-6288-4808-9582-b14c6e3af47d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:53.809540 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688f7ee-6288-4808-9582-b14c6e3af47d None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:53.824094 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 465/907] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 27 20:15:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:53.830666 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c8d53-b427-4ef2-b412-a268039a79e2 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:53.928865 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c8d53-b427-4ef2-b412-a268039a79e2 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:53.960846 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f879f3-aca3-4c9e-8c9a-07666a685527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:53.961450 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f879f3-aca3-4c9e-8c9a-07666a685527 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:53.961730 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f879f3-aca3-4c9e-8c9a-07666a685527 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:53.962001 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f879f3-aca3-4c9e-8c9a-07666a685527 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:53.962772 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f879f3-aca3-4c9e-8c9a-07666a685527 None admin] RBAC: Adding query filter params (role.id=df8ec36d044b469d8854eba8394eb107, scope.project.id=75313278ff3747909a57b6f37496d31e, user.id=733839729aa249e0823f24a8e8fb3ffe) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:53.963106 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f879f3-aca3-4c9e-8c9a-07666a685527 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:53.964518 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f879f3-aca3-4c9e-8c9a-07666a685527 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:53.970808 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 443/908] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 27 20:15:53 2022] GET /identity/v3/role_assignments?user.id=733839729aa249e0823f24a8e8fb3ffe&scope.project.id=75313278ff3747909a57b6f37496d31e&role.id=df8ec36d044b469d8854eba8394eb107 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:15:56.195244 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7876f-f525-437a-87f3-4642bc1a1225 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:56.195812 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7876f-f525-437a-87f3-4642bc1a1225 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:56.195812 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7876f-f525-437a-87f3-4642bc1a1225 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:56.197119 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 466/909] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:15:56.202196 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c472c-ecb1-432e-9a3b-f7a64876a362 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:56.202586 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c472c-ecb1-432e-9a3b-f7a64876a362 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:56.202751 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c472c-ecb1-432e-9a3b-f7a64876a362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:56.220866 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-f17c472c-ecb1-432e-9a3b-f7a64876a362 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:15:56.222049 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-f17c472c-ecb1-432e-9a3b-f7a64876a362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:15:56.251543 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:56.287228 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 444/910] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:15:56 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:15:56.311375 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7876f-f525-437a-87f3-4642bc1a1225 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:56.408998 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7876f-f525-437a-87f3-4642bc1a1225 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:56.415934 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:56.442635 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce55d21-28b5-430e-b708-6b9ed5e6a1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:56.443290 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce55d21-28b5-430e-b708-6b9ed5e6a1f8 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:56.443571 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce55d21-28b5-430e-b708-6b9ed5e6a1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:56.443846 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce55d21-28b5-430e-b708-6b9ed5e6a1f8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:56.444462 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce55d21-28b5-430e-b708-6b9ed5e6a1f8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:56.445872 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce55d21-28b5-430e-b708-6b9ed5e6a1f8 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:56.454416 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-1ce55d21-28b5-430e-b708-6b9ed5e6a1f8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 20:15:56.454416 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:56.454416 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 20:15:56.454416 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 20:15:56.454416 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 20:15:56.454416 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 20:15:56.454416 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 20:15:56.454416 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:15:56.454416 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 20:15:56.454416 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:15:56.454416 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 20:15:56.454416 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:15:56.454416 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:15:56.454416 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:15:56.454416 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:15:56.454416 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:15:56.454416 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:15:56.455620 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:15:56.455620 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:15:56.455620 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:15:56.455620 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:15:56.455620 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:15:56.455620 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:15:56.455620 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 20:15:56.455620 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 20:15:56.455620 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 20:15:56.455620 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 20:15:56.455620 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:15:56.455620 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:15:56.455620 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:15:56.455620 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:15:56.455620 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:15:56.455620 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:15:56.456492 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:15:56.456492 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:15:56.456492 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:15:56.456492 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:15:56.456492 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:15:56.456492 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:15:56.456492 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:15:56.456492 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:15:56.456492 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:15:56.456492 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:15:56.456492 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 20:15:56.456492 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:15:56.456492 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 20:15:56.456492 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:15:56.456492 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 467/911] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Jul 27 20:15:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:15:56.461666 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c472c-ecb1-432e-9a3b-f7a64876a362 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:56.557025 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c472c-ecb1-432e-9a3b-f7a64876a362 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:56.589145 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bfdb6-c42c-4536-84cb-ae8effdf8d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:56.589753 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bfdb6-c42c-4536-84cb-ae8effdf8d01 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:56.590035 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bfdb6-c42c-4536-84cb-ae8effdf8d01 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:56.590307 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bfdb6-c42c-4536-84cb-ae8effdf8d01 None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:56.591524 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491bfdb6-c42c-4536-84cb-ae8effdf8d01 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:56.591830 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491bfdb6-c42c-4536-84cb-ae8effdf8d01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:56.593176 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491bfdb6-c42c-4536-84cb-ae8effdf8d01 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:56.597763 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 445/912] 10.222.0.83 () {56 vars in 1116 bytes} [Wed Jul 27 20:15:56 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:56.603272 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce55d21-28b5-430e-b708-6b9ed5e6a1f8 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:56.698280 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce55d21-28b5-430e-b708-6b9ed5e6a1f8 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:56.729931 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21eb291-83ae-4315-80eb-165acd062cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:56.730529 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21eb291-83ae-4315-80eb-165acd062cff None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:56.730808 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21eb291-83ae-4315-80eb-165acd062cff None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:56.731676 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21eb291-83ae-4315-80eb-165acd062cff None admin] PATH_INFO: `/v3/services` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:56.732338 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21eb291-83ae-4315-80eb-165acd062cff None admin] RBAC: Adding query filter params (type=placement) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:15:56.732648 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21eb291-83ae-4315-80eb-165acd062cff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:56.734000 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21eb291-83ae-4315-80eb-165acd062cff None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:56.738212 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 468/913] 10.222.0.83 () {56 vars in 1116 bytes} [Wed Jul 27 20:15:56 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:15:58.943261 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4e78a-256a-432a-a549-fa7ceeef8e4c None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:58.943795 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4e78a-256a-432a-a549-fa7ceeef8e4c None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:58.943902 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4e78a-256a-432a-a549-fa7ceeef8e4c None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:58.945660 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 446/914] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:15:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:15:58.952215 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726fe19-1524-4422-a394-9f3a21381361 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:58.952626 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726fe19-1524-4422-a394-9f3a21381361 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:58.952825 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726fe19-1524-4422-a394-9f3a21381361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:58.974826 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-7726fe19-1524-4422-a394-9f3a21381361 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:15:58.976772 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-7726fe19-1524-4422-a394-9f3a21381361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:15:59.010584 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:59.052915 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 469/915] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:15:58 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:15:59.077057 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4e78a-256a-432a-a549-fa7ceeef8e4c None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:15:59.117749 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:59.193032 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4e78a-256a-432a-a549-fa7ceeef8e4c None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:15:59.225209 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485423a-5c38-424e-89ca-b9bf35b599eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:15:59.225821 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485423a-5c38-424e-89ca-b9bf35b599eb None admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:15:59.226102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485423a-5c38-424e-89ca-b9bf35b599eb None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:15:59.226377 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485423a-5c38-424e-89ca-b9bf35b599eb None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:15:59.227087 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485423a-5c38-424e-89ca-b9bf35b599eb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:15:59.228461 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485423a-5c38-424e-89ca-b9bf35b599eb None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:15:59.242907 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 447/916] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Jul 27 20:15:59 2022] POST /identity/v3/services => generated 246 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:16:01.463538 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6a5ce-fb38-439a-ac6d-8a0ebca8f0f2 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:16:01.464056 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6a5ce-fb38-439a-ac6d-8a0ebca8f0f2 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:16:01.464169 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6a5ce-fb38-439a-ac6d-8a0ebca8f0f2 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:16:01.465414 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 470/917] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:16:01.471124 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ac9cb-b119-4331-9474-15bca74a0b64 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:16:01.471523 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ac9cb-b119-4331-9474-15bca74a0b64 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:16:01.471676 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ac9cb-b119-4331-9474-15bca74a0b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:16:01.489189 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-148ac9cb-b119-4331-9474-15bca74a0b64 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:16:01.490367 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-148ac9cb-b119-4331-9474-15bca74a0b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:16:01.559449 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 448/918] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:16:01 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:16:01.582847 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6a5ce-fb38-439a-ac6d-8a0ebca8f0f2 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:16:01.679543 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6a5ce-fb38-439a-ac6d-8a0ebca8f0f2 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:16:01.712141 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede08f5-1bbb-4c0e-949b-5aa7db6aff71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:16:01.712757 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede08f5-1bbb-4c0e-949b-5aa7db6aff71 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:16:01.713033 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede08f5-1bbb-4c0e-949b-5aa7db6aff71 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:16:01.713305 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede08f5-1bbb-4c0e-949b-5aa7db6aff71 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:16:01.713920 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede08f5-1bbb-4c0e-949b-5aa7db6aff71 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:16:01.715301 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede08f5-1bbb-4c0e-949b-5aa7db6aff71 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:16:01.724001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-3ede08f5-1bbb-4c0e-949b-5aa7db6aff71 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 20:16:01.724001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:16:01.724001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 20:16:01.724001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 20:16:01.724001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 20:16:01.724001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 20:16:01.724001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 20:16:01.724001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:16:01.724001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 20:16:01.724001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:16:01.724001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 20:16:01.724001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:16:01.724001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:16:01.724001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:16:01.724001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:16:01.724001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:16:01.724001 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:16:01.724978 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:16:01.724978 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:16:01.724978 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:16:01.724978 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:16:01.724978 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:16:01.724978 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:16:01.724978 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 20:16:01.724978 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 20:16:01.724978 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 20:16:01.724978 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 20:16:01.724978 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:16:01.724978 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:16:01.724978 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:16:01.724978 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:16:01.724978 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:16:01.724978 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:16:01.725868 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:16:01.725868 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:16:01.725868 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:16:01.725868 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:16:01.725868 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:16:01.725868 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:16:01.725868 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:16:01.725868 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:16:01.725868 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:16:01.725868 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:16:01.725868 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 20:16:01.725868 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:16:01.725868 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 20:16:01.725868 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:16:01.725868 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 471/919] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Jul 27 20:16:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:16:01.731044 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ac9cb-b119-4331-9474-15bca74a0b64 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:16:01.749366 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:01.828134 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ac9cb-b119-4331-9474-15bca74a0b64 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:16:01.860496 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1093989-5e61-41dc-a09a-aa8efc396994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:16:01.861047 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1093989-5e61-41dc-a09a-aa8efc396994 None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:16:01.861328 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1093989-5e61-41dc-a09a-aa8efc396994 None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:16:01.861594 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1093989-5e61-41dc-a09a-aa8efc396994 None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:16:01.862256 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1093989-5e61-41dc-a09a-aa8efc396994 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:16:01.862554 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1093989-5e61-41dc-a09a-aa8efc396994 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:16:01.863929 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1093989-5e61-41dc-a09a-aa8efc396994 None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:16:01.868758 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 449/920] 10.222.0.83 () {56 vars in 1116 bytes} [Wed Jul 27 20:16:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:16:01.875451 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede08f5-1bbb-4c0e-949b-5aa7db6aff71 None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:16:01.903515 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:01.988694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede08f5-1bbb-4c0e-949b-5aa7db6aff71 None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:16:02.023046 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d961d-ed81-4400-9987-5c83c2c1a552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:16:02.023682 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d961d-ed81-4400-9987-5c83c2c1a552 None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:16:02.023963 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d961d-ed81-4400-9987-5c83c2c1a552 None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:16:02.024237 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d961d-ed81-4400-9987-5c83c2c1a552 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:16:02.024978 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d961d-ed81-4400-9987-5c83c2c1a552 None admin] RBAC: Adding query filter params (interface=public, service_id=b55b734b5c4c44ac8c64ca24de930625, region_id=RegionOne) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:16:02.025289 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d961d-ed81-4400-9987-5c83c2c1a552 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:16:02.026660 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d961d-ed81-4400-9987-5c83c2c1a552 None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:16:02.031676 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 472/921] 10.222.0.83 () {56 vars in 1251 bytes} [Wed Jul 27 20:16:01 2022] GET /identity/v3/endpoints?service_id=b55b734b5c4c44ac8c64ca24de930625&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:16:02.037247 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1093989-5e61-41dc-a09a-aa8efc396994 None admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:16:02.116379 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:02.138511 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1093989-5e61-41dc-a09a-aa8efc396994 None admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:16:02.170806 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c1cf9-d1b0-469c-b5d3-5646d9e57dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:16:02.171440 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c1cf9-d1b0-469c-b5d3-5646d9e57dfd None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:16:02.171719 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c1cf9-d1b0-469c-b5d3-5646d9e57dfd None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:16:02.171993 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c1cf9-d1b0-469c-b5d3-5646d9e57dfd None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:16:02.172640 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c1cf9-d1b0-469c-b5d3-5646d9e57dfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:16:02.173991 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c1cf9-d1b0-469c-b5d3-5646d9e57dfd None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:16:02.180356 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 450/922] 10.222.0.83 () {56 vars in 1087 bytes} [Wed Jul 27 20:16:02 2022] GET /identity/v3/services => generated 1962 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 20:16:04.379907 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e83502-43a4-483e-943c-8270ede1d0ed None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:16:04.380414 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e83502-43a4-483e-943c-8270ede1d0ed None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:16:04.380520 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e83502-43a4-483e-943c-8270ede1d0ed None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:16:04.381765 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 473/923] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:16:04.386782 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229a4d1-29f0-4119-a3f9-c9719468fb5c None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:16:04.387234 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229a4d1-29f0-4119-a3f9-c9719468fb5c None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:16:04.387372 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229a4d1-29f0-4119-a3f9-c9719468fb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:16:04.406089 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-c229a4d1-29f0-4119-a3f9-c9719468fb5c None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:16:04.407298 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-c229a4d1-29f0-4119-a3f9-c9719468fb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:16:04.471541 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 451/924] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:16:04 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 20:16:04.495031 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e83502-43a4-483e-943c-8270ede1d0ed None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:16:04.585617 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:04.596145 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e83502-43a4-483e-943c-8270ede1d0ed None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:16:04.627584 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de0f87-2946-4f74-8202-22b8116f88aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:16:04.628201 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de0f87-2946-4f74-8202-22b8116f88aa None admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:16:04.628478 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de0f87-2946-4f74-8202-22b8116f88aa None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:16:04.628746 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de0f87-2946-4f74-8202-22b8116f88aa None admin] PATH_INFO: `/v3/services/placement` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:16:04.629358 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de0f87-2946-4f74-8202-22b8116f88aa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:16:04.630706 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de0f87-2946-4f74-8202-22b8116f88aa None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:16:04.639663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application [None req-69de0f87-2946-4f74-8202-22b8116f88aa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 20:16:04.639663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:16:04.639663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 20:16:04.639663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 20:16:04.639663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 20:16:04.639663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 20:16:04.639663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 20:16:04.639663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:16:04.639663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 20:16:04.639663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:16:04.639663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 20:16:04.639663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:16:04.639663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 20:16:04.639663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 20:16:04.639663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 20:16:04.639663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 20:16:04.639663 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 20:16:04.640808 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 20:16:04.640808 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 20:16:04.640808 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 20:16:04.640808 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 20:16:04.640808 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 20:16:04.640808 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 20:16:04.640808 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 20:16:04.640808 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 20:16:04.640808 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 20:16:04.640808 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 20:16:04.640808 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 20:16:04.640808 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 20:16:04.640808 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 20:16:04.640808 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 20:16:04.640808 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 20:16:04.640808 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 20:16:04.642065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 20:16:04.642065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application with Lock( Jul 27 20:16:04.642065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 20:16:04.642065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self._enter() Jul 27 20:16:04.642065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 20:16:04.642065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 20:16:04.642065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 20:16:04.642065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application return self.creator() Jul 27 20:16:04.642065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 20:16:04.642065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application created_value = creator( Jul 27 20:16:04.642065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 20:16:04.642065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 20:16:04.642065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 20:16:04.642065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: ERROR keystone.server.flask.application Jul 27 20:16:04.642065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 474/925] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Jul 27 20:16:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 20:16:04.646698 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229a4d1-29f0-4119-a3f9-c9719468fb5c None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:16:04.719013 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:04.740831 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229a4d1-29f0-4119-a3f9-c9719468fb5c None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:16:04.774087 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45a5da-e9a0-4451-9f40-b6761a087bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:16:04.774702 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45a5da-e9a0-4451-9f40-b6761a087bab None admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:16:04.774978 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45a5da-e9a0-4451-9f40-b6761a087bab None admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:16:04.775280 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45a5da-e9a0-4451-9f40-b6761a087bab None admin] PATH_INFO: `/v3/services` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:16:04.775942 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45a5da-e9a0-4451-9f40-b6761a087bab None admin] RBAC: Adding query filter params (name=placement) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:16:04.776241 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45a5da-e9a0-4451-9f40-b6761a087bab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:16:04.777666 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45a5da-e9a0-4451-9f40-b6761a087bab None admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:16:04.782614 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 452/926] 10.222.0.83 () {56 vars in 1116 bytes} [Wed Jul 27 20:16:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:16:04.788439 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de0f87-2946-4f74-8202-22b8116f88aa None admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:16:04.883839 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de0f87-2946-4f74-8202-22b8116f88aa None admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:16:04.915894 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0f474-1f54-4a77-a510-84a422a1da5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:16:04.916482 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0f474-1f54-4a77-a510-84a422a1da5b None admin] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:16:04.916760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0f474-1f54-4a77-a510-84a422a1da5b None admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:16:04.917032 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0f474-1f54-4a77-a510-84a422a1da5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:16:04.917718 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0f474-1f54-4a77-a510-84a422a1da5b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:16:04.919129 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0f474-1f54-4a77-a510-84a422a1da5b None admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:16:04.940702 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 475/927] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Jul 27 20:16:04 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:16:14.780232 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=30 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:14.934320 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:17:03.124909 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca7da3-9f0e-4613-9070-2d12ca906309 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:03.125759 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca7da3-9f0e-4613-9070-2d12ca906309 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:03.125759 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca7da3-9f0e-4613-9070-2d12ca906309 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:03.132458 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 453/928] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:17:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:17:03.133053 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc28f5-1909-4941-b7ef-3c42afb07a7d None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:03.133510 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc28f5-1909-4941-b7ef-3c42afb07a7d None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:03.133590 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc28f5-1909-4941-b7ef-3c42afb07a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:03.164987 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-30fc28f5-1909-4941-b7ef-3c42afb07a7d None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:17:03.166239 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-30fc28f5-1909-4941-b7ef-3c42afb07a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:17:03.248004 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 476/929] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:17:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 20:17:03.302131 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daae12-d058-41ac-9dc7-5a26af3db93a None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:03.302487 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daae12-d058-41ac-9dc7-5a26af3db93a None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:03.302842 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daae12-d058-41ac-9dc7-5a26af3db93a None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:03.304363 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 454/930] 10.222.0.83 () {54 vars in 965 bytes} [Wed Jul 27 20:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:17:03.313335 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d306198-b2eb-476c-8ced-fb1ca868f413 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:03.313335 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d306198-b2eb-476c-8ced-fb1ca868f413 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:03.313335 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d306198-b2eb-476c-8ced-fb1ca868f413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:03.408318 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-5d306198-b2eb-476c-8ced-fb1ca868f413 None None] MFA Rules not processed for user `308f029a3e7b46fbaff75a01720c8986`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:17:03.409871 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-5d306198-b2eb-476c-8ced-fb1ca868f413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:17:03.499820 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 477/931] 10.222.0.83 () {58 vars in 1062 bytes} [Wed Jul 27 20:17:03 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:17:03.500497 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83daae12-d058-41ac-9dc7-5a26af3db93a None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:17:03.514233 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83daae12-d058-41ac-9dc7-5a26af3db93a None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:17:03.519064 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0eb43f-a9a1-492e-8b14-400268f9f3ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:17:03.519910 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eb43f-a9a1-492e-8b14-400268f9f3ed service neutron] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:03.520460 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eb43f-a9a1-492e-8b14-400268f9f3ed service neutron] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:03.520890 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eb43f-a9a1-492e-8b14-400268f9f3ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:03.535632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0eb43f-a9a1-492e-8b14-400268f9f3ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:17:03.535632 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0eb43f-a9a1-492e-8b14-400268f9f3ed service neutron] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:17:03.546376 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 455/932] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:17:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:17:06.002795 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779527d1-6789-4979-9acc-03f9066ea15d None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:06.003371 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779527d1-6789-4979-9acc-03f9066ea15d None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:06.003371 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779527d1-6789-4979-9acc-03f9066ea15d None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:06.004839 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 478/933] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:17:06.009947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e441b5a-d521-4002-a9dd-a2104d2c7abf None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:06.010389 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e441b5a-d521-4002-a9dd-a2104d2c7abf None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:06.010496 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e441b5a-d521-4002-a9dd-a2104d2c7abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:06.030447 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-3e441b5a-d521-4002-a9dd-a2104d2c7abf None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:17:06.031708 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-3e441b5a-d521-4002-a9dd-a2104d2c7abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:17:06.039484 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 456/934] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:17:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:17:06.078583 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779527d1-6789-4979-9acc-03f9066ea15d None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:17:06.089568 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779527d1-6789-4979-9acc-03f9066ea15d None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:17:06.093622 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f403c6-cff9-4885-a84d-5e043b8bd3f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:17:06.094220 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f403c6-cff9-4885-a84d-5e043b8bd3f9 service neutron] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:06.094500 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f403c6-cff9-4885-a84d-5e043b8bd3f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:06.094774 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f403c6-cff9-4885-a84d-5e043b8bd3f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:06.104016 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f403c6-cff9-4885-a84d-5e043b8bd3f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:17:06.105452 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f403c6-cff9-4885-a84d-5e043b8bd3f9 service neutron] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:17:06.115521 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 479/935] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:17:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:17:08.708306 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e698565-53be-40f2-9b1c-a9dd4a25c3e7 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:08.708848 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e698565-53be-40f2-9b1c-a9dd4a25c3e7 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:08.708848 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e698565-53be-40f2-9b1c-a9dd4a25c3e7 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:08.711416 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 457/936] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:17:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:17:08.715244 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09185abf-6120-4561-bd29-5727ba81dda5 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:08.715681 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09185abf-6120-4561-bd29-5727ba81dda5 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:08.715845 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09185abf-6120-4561-bd29-5727ba81dda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:08.754705 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-09185abf-6120-4561-bd29-5727ba81dda5 None None] MFA Rules not processed for user `5f1e12dbf11d4d17913d66e0e88d33c8`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:17:08.755922 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-09185abf-6120-4561-bd29-5727ba81dda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:17:08.797995 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=100 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:17:08.825424 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 480/937] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:17:08 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:17:08.866096 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e698565-53be-40f2-9b1c-a9dd4a25c3e7 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:17:08.877464 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e698565-53be-40f2-9b1c-a9dd4a25c3e7 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:17:08.880934 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d268809-98fb-470c-8cbf-390caa79115a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:17:08.881557 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d268809-98fb-470c-8cbf-390caa79115a service neutron] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:08.881900 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d268809-98fb-470c-8cbf-390caa79115a service neutron] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:08.882237 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d268809-98fb-470c-8cbf-390caa79115a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:08.892445 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d268809-98fb-470c-8cbf-390caa79115a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:17:08.893954 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d268809-98fb-470c-8cbf-390caa79115a service neutron] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:17:08.903965 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 458/938] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:17:08 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:17:11.738151 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6815756-fde1-4cfb-a7af-9effe7f8542b None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:11.738668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6815756-fde1-4cfb-a7af-9effe7f8542b None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:11.738762 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6815756-fde1-4cfb-a7af-9effe7f8542b None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:11.740064 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 481/939] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:17:11.745206 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ab7b6-a2f1-4a3b-8c53-eb90fa87eeb7 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:11.745627 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ab7b6-a2f1-4a3b-8c53-eb90fa87eeb7 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:11.745729 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ab7b6-a2f1-4a3b-8c53-eb90fa87eeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:11.764294 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-568ab7b6-a2f1-4a3b-8c53-eb90fa87eeb7 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:17:11.765460 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-568ab7b6-a2f1-4a3b-8c53-eb90fa87eeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:17:11.836572 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 459/940] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:17:11 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 20:17:11.875877 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6815756-fde1-4cfb-a7af-9effe7f8542b None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:17:11.886299 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6815756-fde1-4cfb-a7af-9effe7f8542b None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:17:11.890352 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a58815-93e2-481a-a478-13452feccad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:17:11.890948 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a58815-93e2-481a-a478-13452feccad1 service neutron] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:11.891258 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a58815-93e2-481a-a478-13452feccad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:11.891529 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a58815-93e2-481a-a478-13452feccad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:11.900150 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a58815-93e2-481a-a478-13452feccad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:17:11.901583 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a58815-93e2-481a-a478-13452feccad1 service neutron] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:17:11.911703 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 482/941] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:17:11 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 20:17:14.766535 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731596a-4722-4de3-8c8f-bc264a84bd09 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:14.767121 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731596a-4722-4de3-8c8f-bc264a84bd09 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:14.767121 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731596a-4722-4de3-8c8f-bc264a84bd09 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:14.768491 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 460/942] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:17:14.773786 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a15e4-303c-44b3-90b4-c9af0acaaf6c None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:14.774216 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a15e4-303c-44b3-90b4-c9af0acaaf6c None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:14.774489 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a15e4-303c-44b3-90b4-c9af0acaaf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:14.793821 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-382a15e4-303c-44b3-90b4-c9af0acaaf6c None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:17:14.795002 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-382a15e4-303c-44b3-90b4-c9af0acaaf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:17:14.803335 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 483/943] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:17:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:17:14.840424 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731596a-4722-4de3-8c8f-bc264a84bd09 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:17:14.851709 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731596a-4722-4de3-8c8f-bc264a84bd09 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:17:14.855167 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc6779-d8ad-4d97-836e-76b2b415f30e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:17:14.855777 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc6779-d8ad-4d97-836e-76b2b415f30e service neutron] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:14.856059 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc6779-d8ad-4d97-836e-76b2b415f30e service neutron] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:14.856332 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc6779-d8ad-4d97-836e-76b2b415f30e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:14.865045 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc6779-d8ad-4d97-836e-76b2b415f30e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:17:14.866464 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc6779-d8ad-4d97-836e-76b2b415f30e service neutron] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:17:14.875952 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 461/944] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:17:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:17:17.160322 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317ff34-f147-4ff1-88d0-f73577057f9b None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:17.160846 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317ff34-f147-4ff1-88d0-f73577057f9b None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:17.160846 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317ff34-f147-4ff1-88d0-f73577057f9b None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:17.162093 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 484/945] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:17:17.167293 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03014bbc-dd6a-4bf8-9c61-5e9cdc31bff2 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:17.167720 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03014bbc-dd6a-4bf8-9c61-5e9cdc31bff2 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:17.167976 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03014bbc-dd6a-4bf8-9c61-5e9cdc31bff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:17.187726 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-03014bbc-dd6a-4bf8-9c61-5e9cdc31bff2 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:17:17.188916 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-03014bbc-dd6a-4bf8-9c61-5e9cdc31bff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:17:17.196497 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 462/946] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:17:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:17:17.232053 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317ff34-f147-4ff1-88d0-f73577057f9b None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:17:17.242782 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317ff34-f147-4ff1-88d0-f73577057f9b None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:17:17.246292 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec957e7-52ab-4b86-aa68-e6f6e4f6ee57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:17:17.246882 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec957e7-52ab-4b86-aa68-e6f6e4f6ee57 service neutron] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:17.247187 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec957e7-52ab-4b86-aa68-e6f6e4f6ee57 service neutron] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:17.247457 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec957e7-52ab-4b86-aa68-e6f6e4f6ee57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:17.256818 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec957e7-52ab-4b86-aa68-e6f6e4f6ee57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:17:17.258233 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec957e7-52ab-4b86-aa68-e6f6e4f6ee57 service neutron] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:17:17.268618 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 485/947] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:17:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:17:19.542313 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab4741-3385-4473-84b6-11c8efe05ad1 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:19.542953 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab4741-3385-4473-84b6-11c8efe05ad1 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:19.542953 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab4741-3385-4473-84b6-11c8efe05ad1 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:19.544230 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 463/948] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:17:19.549771 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9e787-91ca-414e-95a5-853aaa8dbeba None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:19.550226 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9e787-91ca-414e-95a5-853aaa8dbeba None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:19.550325 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9e787-91ca-414e-95a5-853aaa8dbeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:19.569577 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-d0e9e787-91ca-414e-95a5-853aaa8dbeba None None] MFA Rules not processed for user `5f1e12dbf11d4d17913d66e0e88d33c8`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:17:19.570745 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-d0e9e787-91ca-414e-95a5-853aaa8dbeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:17:19.578314 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 486/949] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:17:19 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:17:19.629986 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d513a15-0a6d-408e-bca5-3a76aca0a999 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:19.630271 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d513a15-0a6d-408e-bca5-3a76aca0a999 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:19.630548 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d513a15-0a6d-408e-bca5-3a76aca0a999 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:19.631931 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 464/950] 10.222.0.83 () {54 vars in 965 bytes} [Wed Jul 27 20:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:17:19.637757 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c053d1-1d0f-4cd7-8238-7c258f2ec6c9 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:19.638111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c053d1-1d0f-4cd7-8238-7c258f2ec6c9 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:19.638447 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c053d1-1d0f-4cd7-8238-7c258f2ec6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:19.657494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-85c053d1-1d0f-4cd7-8238-7c258f2ec6c9 None None] MFA Rules not processed for user `308f029a3e7b46fbaff75a01720c8986`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:17:19.658666 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-85c053d1-1d0f-4cd7-8238-7c258f2ec6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:17:19.665161 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 487/951] 10.222.0.83 () {58 vars in 1062 bytes} [Wed Jul 27 20:17:19 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 20:17:19.674196 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d513a15-0a6d-408e-bca5-3a76aca0a999 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:17:19.684693 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d513a15-0a6d-408e-bca5-3a76aca0a999 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:17:19.688755 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b5b0d-4a15-4012-95c1-35a082225594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:17:19.689378 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b5b0d-4a15-4012-95c1-35a082225594 service neutron] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:19.689662 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b5b0d-4a15-4012-95c1-35a082225594 service neutron] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:19.689937 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b5b0d-4a15-4012-95c1-35a082225594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:19.699659 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b5b0d-4a15-4012-95c1-35a082225594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:17:19.701092 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b5b0d-4a15-4012-95c1-35a082225594 service neutron] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:17:19.710657 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 465/952] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:17:19 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:17:22.524643 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec725a35-5af3-48d2-8ee0-3f2e7ff0fd8d None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:22.525190 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec725a35-5af3-48d2-8ee0-3f2e7ff0fd8d None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:22.525190 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec725a35-5af3-48d2-8ee0-3f2e7ff0fd8d None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:22.526501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 488/953] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:17:22.531699 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c32ca-749a-4425-a6c0-421912511e1f None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:22.532127 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c32ca-749a-4425-a6c0-421912511e1f None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:22.532386 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c32ca-749a-4425-a6c0-421912511e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:22.551442 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-565c32ca-749a-4425-a6c0-421912511e1f None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:17:22.552706 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-565c32ca-749a-4425-a6c0-421912511e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:17:22.560444 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 466/954] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:17:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:17:22.597075 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec725a35-5af3-48d2-8ee0-3f2e7ff0fd8d None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:17:22.607928 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec725a35-5af3-48d2-8ee0-3f2e7ff0fd8d None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:17:22.612191 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897a2c3-f272-480a-908b-eeabb5646161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:17:22.612829 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897a2c3-f272-480a-908b-eeabb5646161 service neutron] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:22.613111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897a2c3-f272-480a-908b-eeabb5646161 service neutron] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:22.613387 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897a2c3-f272-480a-908b-eeabb5646161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:22.623340 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897a2c3-f272-480a-908b-eeabb5646161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:17:22.625441 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897a2c3-f272-480a-908b-eeabb5646161 service neutron] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:17:22.636526 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 489/955] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:17:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:17:24.924986 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7608e-d395-4314-9b38-8845f5f00228 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:24.925504 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7608e-d395-4314-9b38-8845f5f00228 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:24.925614 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7608e-d395-4314-9b38-8845f5f00228 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:24.926894 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 467/956] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:17:24.932536 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b368fb0-0153-4f74-a014-6d8aaeb1fed4 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:24.932955 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b368fb0-0153-4f74-a014-6d8aaeb1fed4 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:24.933157 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b368fb0-0153-4f74-a014-6d8aaeb1fed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:24.953827 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-2b368fb0-0153-4f74-a014-6d8aaeb1fed4 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:17:24.955111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-2b368fb0-0153-4f74-a014-6d8aaeb1fed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:17:24.963100 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 490/957] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:17:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:17:25.005990 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7608e-d395-4314-9b38-8845f5f00228 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:17:25.011431 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=65 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:17:25.017340 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7608e-d395-4314-9b38-8845f5f00228 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:17:25.020793 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842c7dc-806b-4022-aa76-3ef1a385e9ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:17:25.021398 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842c7dc-806b-4022-aa76-3ef1a385e9ec service neutron] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:25.021679 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842c7dc-806b-4022-aa76-3ef1a385e9ec service neutron] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:25.021953 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842c7dc-806b-4022-aa76-3ef1a385e9ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:25.031350 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842c7dc-806b-4022-aa76-3ef1a385e9ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:17:25.032774 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842c7dc-806b-4022-aa76-3ef1a385e9ec service neutron] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:17:25.042368 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 468/958] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:17:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:17:27.639160 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4e286-7104-4eee-a370-24ce1ea889b4 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:27.639690 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4e286-7104-4eee-a370-24ce1ea889b4 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:27.639690 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4e286-7104-4eee-a370-24ce1ea889b4 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:27.641430 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 491/959] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:17:27.646624 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa37a09-776a-408c-a492-c1e4b3b528f1 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:27.647035 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa37a09-776a-408c-a492-c1e4b3b528f1 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:27.647213 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa37a09-776a-408c-a492-c1e4b3b528f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:27.666352 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-6fa37a09-776a-408c-a492-c1e4b3b528f1 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:17:27.667579 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-6fa37a09-776a-408c-a492-c1e4b3b528f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:17:27.675281 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 469/960] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:17:27 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:17:27.712010 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4e286-7104-4eee-a370-24ce1ea889b4 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:17:27.723101 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4e286-7104-4eee-a370-24ce1ea889b4 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:17:27.726525 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9a3a6-3426-48e1-a250-4d3bade44bc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:17:27.727153 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9a3a6-3426-48e1-a250-4d3bade44bc7 service neutron] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:27.727430 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9a3a6-3426-48e1-a250-4d3bade44bc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:27.727700 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9a3a6-3426-48e1-a250-4d3bade44bc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:27.741266 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9a3a6-3426-48e1-a250-4d3bade44bc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:17:27.742695 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9a3a6-3426-48e1-a250-4d3bade44bc7 service neutron] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:17:27.752254 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 492/961] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:17:27 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:17:32.026472 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add59411-66ec-4566-8f9a-29796771cc5d None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:32.026966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add59411-66ec-4566-8f9a-29796771cc5d None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:32.026966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add59411-66ec-4566-8f9a-29796771cc5d None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:32.028344 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 470/962] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:17:32.033501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d48588-ef3e-4356-be90-5aee1939ffc5 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:32.033881 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d48588-ef3e-4356-be90-5aee1939ffc5 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:32.034170 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d48588-ef3e-4356-be90-5aee1939ffc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:32.053618 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-78d48588-ef3e-4356-be90-5aee1939ffc5 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:17:32.054741 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-78d48588-ef3e-4356-be90-5aee1939ffc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:17:32.062947 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 493/963] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:17:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:17:32.106696 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add59411-66ec-4566-8f9a-29796771cc5d None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:17:32.120638 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add59411-66ec-4566-8f9a-29796771cc5d None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:17:32.124203 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd70b1-0bdb-42fe-8ad7-1ffa49ad49c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:17:32.125344 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd70b1-0bdb-42fe-8ad7-1ffa49ad49c5 service neutron] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:32.125620 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd70b1-0bdb-42fe-8ad7-1ffa49ad49c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:32.125889 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd70b1-0bdb-42fe-8ad7-1ffa49ad49c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:32.134945 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd70b1-0bdb-42fe-8ad7-1ffa49ad49c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:17:32.136391 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd70b1-0bdb-42fe-8ad7-1ffa49ad49c5 service neutron] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:17:32.145704 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 471/964] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:17:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:17:35.016425 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfece1a-6fcc-4a54-bee4-8b79a7352a08 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:35.016875 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfece1a-6fcc-4a54-bee4-8b79a7352a08 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:35.016979 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfece1a-6fcc-4a54-bee4-8b79a7352a08 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:35.018283 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 494/965] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:17:35.023448 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b111ff-a69c-4049-8067-963ab2da3e08 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:35.023833 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b111ff-a69c-4049-8067-963ab2da3e08 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:35.024002 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b111ff-a69c-4049-8067-963ab2da3e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:35.043043 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-56b111ff-a69c-4049-8067-963ab2da3e08 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:17:35.044264 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-56b111ff-a69c-4049-8067-963ab2da3e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:17:35.052722 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 472/966] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:17:35 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:17:35.090838 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfece1a-6fcc-4a54-bee4-8b79a7352a08 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:17:35.102125 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfece1a-6fcc-4a54-bee4-8b79a7352a08 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:17:35.105711 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9dc590-5ecd-41ed-b3e1-890cf18bffc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:17:35.106336 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9dc590-5ecd-41ed-b3e1-890cf18bffc9 service neutron] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:35.106616 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9dc590-5ecd-41ed-b3e1-890cf18bffc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:35.106888 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9dc590-5ecd-41ed-b3e1-890cf18bffc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:35.115696 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9dc590-5ecd-41ed-b3e1-890cf18bffc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:17:35.117127 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9dc590-5ecd-41ed-b3e1-890cf18bffc9 service neutron] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:17:35.126304 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 495/967] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:17:35 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:17:39.641624 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564fe83-247c-4a60-825d-1bb037c22285 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:39.642085 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564fe83-247c-4a60-825d-1bb037c22285 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:39.642295 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564fe83-247c-4a60-825d-1bb037c22285 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:39.643567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 473/968] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:17:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:17:39.648770 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da2b25-5b77-4b02-bc81-c9105d8b31ba None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:39.649194 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da2b25-5b77-4b02-bc81-c9105d8b31ba None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:39.649447 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da2b25-5b77-4b02-bc81-c9105d8b31ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:39.657460 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=57 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:17:39.669908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-79da2b25-5b77-4b02-bc81-c9105d8b31ba None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:17:39.671143 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-79da2b25-5b77-4b02-bc81-c9105d8b31ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:17:39.678858 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 496/969] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:17:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:17:39.718936 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564fe83-247c-4a60-825d-1bb037c22285 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:17:39.729737 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564fe83-247c-4a60-825d-1bb037c22285 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:17:39.733306 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226a374-37e7-4b00-87b5-23ef76ab6bb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:17:39.733985 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226a374-37e7-4b00-87b5-23ef76ab6bb1 service neutron] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:39.734268 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226a374-37e7-4b00-87b5-23ef76ab6bb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:39.734545 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226a374-37e7-4b00-87b5-23ef76ab6bb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:39.743732 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226a374-37e7-4b00-87b5-23ef76ab6bb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:17:39.745158 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226a374-37e7-4b00-87b5-23ef76ab6bb1 service neutron] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:17:39.754642 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 474/970] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:17:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:17:45.195641 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15da229-7b25-400b-a14a-7bfb533af15c None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:45.196111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15da229-7b25-400b-a14a-7bfb533af15c None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:45.196111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15da229-7b25-400b-a14a-7bfb533af15c None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:45.197763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 497/971] 10.222.0.83 () {54 vars in 921 bytes} [Wed Jul 27 20:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:17:45.203905 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5eb0b4-bdf9-4e92-a994-dbeb765ce55a None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:45.204652 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5eb0b4-bdf9-4e92-a994-dbeb765ce55a None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:45.205102 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5eb0b4-bdf9-4e92-a994-dbeb765ce55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:45.255266 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-2f5eb0b4-bdf9-4e92-a994-dbeb765ce55a None None] MFA Rules not processed for user `733839729aa249e0823f24a8e8fb3ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:17:45.256700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-2f5eb0b4-bdf9-4e92-a994-dbeb765ce55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:17:45.333869 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 475/972] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Jul 27 20:17:45 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:17:49.640875 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c1ecc-11eb-4d27-ad55-76a9dcacb6db None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:49.641380 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c1ecc-11eb-4d27-ad55-76a9dcacb6db None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:49.641380 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c1ecc-11eb-4d27-ad55-76a9dcacb6db None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:49.642854 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 498/973] 10.222.0.83 () {54 vars in 921 bytes} [Wed Jul 27 20:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:17:49.647684 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e331f6b-273d-4d59-a0f8-217e5a2db786 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:49.648109 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e331f6b-273d-4d59-a0f8-217e5a2db786 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:49.648435 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e331f6b-273d-4d59-a0f8-217e5a2db786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:49.665093 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=2 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:17:49.668229 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-0e331f6b-273d-4d59-a0f8-217e5a2db786 None None] MFA Rules not processed for user `733839729aa249e0823f24a8e8fb3ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:17:49.669588 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-0e331f6b-273d-4d59-a0f8-217e5a2db786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:17:49.678892 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 476/974] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Jul 27 20:17:49 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:17:51.315229 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815f286-821e-4196-9744-f6b642d32816 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:51.315814 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815f286-821e-4196-9744-f6b642d32816 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:51.315814 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815f286-821e-4196-9744-f6b642d32816 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:51.317122 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 499/975] 10.222.0.83 () {54 vars in 921 bytes} [Wed Jul 27 20:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:17:51.322485 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182d9da-5c98-464b-9c5a-82f2d08dac24 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:51.322926 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182d9da-5c98-464b-9c5a-82f2d08dac24 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:51.323189 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182d9da-5c98-464b-9c5a-82f2d08dac24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:51.345395 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-e182d9da-5c98-464b-9c5a-82f2d08dac24 None None] MFA Rules not processed for user `733839729aa249e0823f24a8e8fb3ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:17:51.346603 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-e182d9da-5c98-464b-9c5a-82f2d08dac24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:17:51.354961 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 477/976] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Jul 27 20:17:51 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:17:55.321079 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21742fa-85dd-4e38-9763-65633184b4f4 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:55.321540 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21742fa-85dd-4e38-9763-65633184b4f4 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:55.321636 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21742fa-85dd-4e38-9763-65633184b4f4 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:55.327269 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 500/977] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:17:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:17:55.328449 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f5d88-e332-4191-84f8-8161cb405c1d None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:55.328885 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f5d88-e332-4191-84f8-8161cb405c1d None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:55.329150 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f5d88-e332-4191-84f8-8161cb405c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:55.336814 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=69 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:17:55.475129 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-f77f5d88-e332-4191-84f8-8161cb405c1d None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:17:55.476465 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-f77f5d88-e332-4191-84f8-8161cb405c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:17:55.484995 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 478/978] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:17:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 20:17:55.549703 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22858ef7-046f-49f1-83c4-c124b60dd55e None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:55.549989 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22858ef7-046f-49f1-83c4-c124b60dd55e None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:55.550260 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22858ef7-046f-49f1-83c4-c124b60dd55e None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:55.552099 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 501/979] 10.222.0.83 () {54 vars in 962 bytes} [Wed Jul 27 20:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:17:55.565429 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7dd27-30d3-45d4-99be-71c2c8387d7b None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:55.566020 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7dd27-30d3-45d4-99be-71c2c8387d7b None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:55.566311 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7dd27-30d3-45d4-99be-71c2c8387d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:55.607597 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-86e7dd27-30d3-45d4-99be-71c2c8387d7b None None] MFA Rules not processed for user `f68b37524d7245e4b606ad8dd15442ef`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:17:55.609612 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-86e7dd27-30d3-45d4-99be-71c2c8387d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:17:55.683993 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 479/980] 10.222.0.83 () {58 vars in 1059 bytes} [Wed Jul 27 20:17:55 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:17:55.693918 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22858ef7-046f-49f1-83c4-c124b60dd55e None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:17:55.708908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22858ef7-046f-49f1-83c4-c124b60dd55e None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:17:55.714852 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c5b97-7901-4dfe-b984-1d68a72ee3d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:17:55.715735 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c5b97-7901-4dfe-b984-1d68a72ee3d5 service nova] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:55.716209 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c5b97-7901-4dfe-b984-1d68a72ee3d5 service nova] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:55.716754 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c5b97-7901-4dfe-b984-1d68a72ee3d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:55.726756 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c5b97-7901-4dfe-b984-1d68a72ee3d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:17:55.728601 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c5b97-7901-4dfe-b984-1d68a72ee3d5 service nova] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:17:55.739554 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 502/981] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:17:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:17:58.197654 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d584d2-6f2c-4c63-99bd-257ead6f2a4b None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:58.198213 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d584d2-6f2c-4c63-99bd-257ead6f2a4b None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:58.198213 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d584d2-6f2c-4c63-99bd-257ead6f2a4b None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:58.199578 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 480/982] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:17:58.205327 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0150492-fbfb-41bf-9919-6609a966382d None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:58.205722 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0150492-fbfb-41bf-9919-6609a966382d None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:58.205852 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0150492-fbfb-41bf-9919-6609a966382d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:58.225154 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-e0150492-fbfb-41bf-9919-6609a966382d None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:17:58.226634 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-e0150492-fbfb-41bf-9919-6609a966382d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:17:58.234553 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 503/983] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:17:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:17:58.280162 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d584d2-6f2c-4c63-99bd-257ead6f2a4b None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:17:58.294568 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d584d2-6f2c-4c63-99bd-257ead6f2a4b None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:17:58.304904 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bbd3f-e2bd-498c-8833-5a1959a9255d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:17:58.305518 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bbd3f-e2bd-498c-8833-5a1959a9255d service nova] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:17:58.305789 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bbd3f-e2bd-498c-8833-5a1959a9255d service nova] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:17:58.306052 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bbd3f-e2bd-498c-8833-5a1959a9255d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:17:58.316964 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bbd3f-e2bd-498c-8833-5a1959a9255d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:17:58.318805 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bbd3f-e2bd-498c-8833-5a1959a9255d service nova] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:17:58.332679 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 481/984] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:17:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:18:00.906924 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba7963-7346-422f-ad46-372a21922c6a None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:00.907811 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba7963-7346-422f-ad46-372a21922c6a None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:00.908257 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba7963-7346-422f-ad46-372a21922c6a None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:00.910096 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 504/985] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:18:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:18:00.916207 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f4567-47b9-4652-aa51-49f35dff8734 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:00.917022 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f4567-47b9-4652-aa51-49f35dff8734 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:00.917470 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f4567-47b9-4652-aa51-49f35dff8734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:00.938092 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-ed1f4567-47b9-4652-aa51-49f35dff8734 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:00.939344 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-ed1f4567-47b9-4652-aa51-49f35dff8734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:00.948796 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 482/986] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:18:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:18:00.996966 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af36ad-0f3a-4435-9070-f78fc7f6a8bc None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:00.997256 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af36ad-0f3a-4435-9070-f78fc7f6a8bc None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:00.997621 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af36ad-0f3a-4435-9070-f78fc7f6a8bc None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:00.998956 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 505/987] 10.222.0.83 () {54 vars in 962 bytes} [Wed Jul 27 20:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:18:01.006546 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ee8b6-87da-4eaa-bc14-2da178820439 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:01.006885 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ee8b6-87da-4eaa-bc14-2da178820439 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:01.007339 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ee8b6-87da-4eaa-bc14-2da178820439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:01.027304 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-9d8ee8b6-87da-4eaa-bc14-2da178820439 None None] MFA Rules not processed for user `f68b37524d7245e4b606ad8dd15442ef`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:01.028522 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-9d8ee8b6-87da-4eaa-bc14-2da178820439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:01.036963 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 483/988] 10.222.0.83 () {58 vars in 1059 bytes} [Wed Jul 27 20:18:01 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:18:01.044622 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af36ad-0f3a-4435-9070-f78fc7f6a8bc None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:18:01.057673 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af36ad-0f3a-4435-9070-f78fc7f6a8bc None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:18:01.063276 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d517f8b-50ce-4d57-93d6-547cfa93bf1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:18:01.063880 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d517f8b-50ce-4d57-93d6-547cfa93bf1c service nova] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:01.064162 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d517f8b-50ce-4d57-93d6-547cfa93bf1c service nova] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:01.064439 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d517f8b-50ce-4d57-93d6-547cfa93bf1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:01.072645 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d517f8b-50ce-4d57-93d6-547cfa93bf1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:18:01.074229 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d517f8b-50ce-4d57-93d6-547cfa93bf1c service nova] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:18:01.084050 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 506/989] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:18:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:18:03.446547 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c92a1-83da-424d-8794-a3db346d271b None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:03.447556 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c92a1-83da-424d-8794-a3db346d271b None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:03.447987 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c92a1-83da-424d-8794-a3db346d271b None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:03.449785 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 484/990] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:18:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:18:03.460679 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649aad79-ae88-4ccd-bd7d-7dbade9a8cfb None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:03.461184 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649aad79-ae88-4ccd-bd7d-7dbade9a8cfb None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:03.461444 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649aad79-ae88-4ccd-bd7d-7dbade9a8cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:03.483470 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-649aad79-ae88-4ccd-bd7d-7dbade9a8cfb None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:03.485832 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-649aad79-ae88-4ccd-bd7d-7dbade9a8cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:03.494680 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 507/991] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:18:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:18:03.542193 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c92a1-83da-424d-8794-a3db346d271b None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:18:03.558567 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c92a1-83da-424d-8794-a3db346d271b None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:18:03.564045 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f917e14-a3e4-45cb-9cd8-a28b97bdd15a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:18:03.564928 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f917e14-a3e4-45cb-9cd8-a28b97bdd15a service nova] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:03.565418 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f917e14-a3e4-45cb-9cd8-a28b97bdd15a service nova] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:03.565919 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f917e14-a3e4-45cb-9cd8-a28b97bdd15a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:03.575313 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f917e14-a3e4-45cb-9cd8-a28b97bdd15a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:18:03.577233 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f917e14-a3e4-45cb-9cd8-a28b97bdd15a service nova] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:18:03.588773 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 485/992] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:18:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:18:05.471296 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ad2f4-2e00-4880-8ff7-63af9fa05cc1 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:05.471744 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ad2f4-2e00-4880-8ff7-63af9fa05cc1 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:05.471744 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ad2f4-2e00-4880-8ff7-63af9fa05cc1 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:05.477181 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 508/993] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:18:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:18:05.478463 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d25dc-195d-4689-a255-c69e5760982e None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:05.479239 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d25dc-195d-4689-a255-c69e5760982e None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:05.479947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d25dc-195d-4689-a255-c69e5760982e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:05.509608 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-c39d25dc-195d-4689-a255-c69e5760982e None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:05.511378 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-c39d25dc-195d-4689-a255-c69e5760982e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:05.520544 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 486/994] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:18:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 20:18:05.848581 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a3565-65ac-41f5-9795-1ea773f73119 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:05.848581 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a3565-65ac-41f5-9795-1ea773f73119 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:05.848581 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a3565-65ac-41f5-9795-1ea773f73119 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:05.851532 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 509/995] 10.222.0.83 () {54 vars in 964 bytes} [Wed Jul 27 20:18:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:18:05.856775 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827a892-44ed-4bb9-8646-1453bb9b6aea None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:05.857136 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827a892-44ed-4bb9-8646-1453bb9b6aea None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:05.857546 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827a892-44ed-4bb9-8646-1453bb9b6aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:05.898626 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-e827a892-44ed-4bb9-8646-1453bb9b6aea None None] MFA Rules not processed for user `4bf3f75970b342609acb2542913b068d`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:05.900134 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-e827a892-44ed-4bb9-8646-1453bb9b6aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:05.962988 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c617699-092e-46cf-b02c-cd118bb4df8b None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:05.963746 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c617699-092e-46cf-b02c-cd118bb4df8b None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:05.964138 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c617699-092e-46cf-b02c-cd118bb4df8b None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:05.966549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 510/996] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:18:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 20:18:05.967116 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 487/997] 10.222.0.83 () {58 vars in 1061 bytes} [Wed Jul 27 20:18:05 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 20:18:05.971727 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed4f3c-2879-4e65-a2e6-b67946362388 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:05.972014 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed4f3c-2879-4e65-a2e6-b67946362388 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:05.972295 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed4f3c-2879-4e65-a2e6-b67946362388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:05.974726 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e827a892-44ed-4bb9-8646-1453bb9b6aea None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:18:05.982888 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e827a892-44ed-4bb9-8646-1453bb9b6aea None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:18:05.987283 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb70bfc-b4b5-442f-962a-b45888399475 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bf3f75970b342609acb2542913b068d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:18:05.988576 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb70bfc-b4b5-442f-962a-b45888399475 service cinder] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:05.988930 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb70bfc-b4b5-442f-962a-b45888399475 service cinder] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:05.989275 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb70bfc-b4b5-442f-962a-b45888399475 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:05.991551 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-a5ed4f3c-2879-4e65-a2e6-b67946362388 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:05.992919 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-a5ed4f3c-2879-4e65-a2e6-b67946362388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:06.000110 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb70bfc-b4b5-442f-962a-b45888399475 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:18:06.001543 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb70bfc-b4b5-442f-962a-b45888399475 service cinder] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:18:06.002578 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 511/998] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:18:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:18:06.005791 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:18:06.013633 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 488/999] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:18:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:18:06.048039 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed4f3c-2879-4e65-a2e6-b67946362388 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:18:06.059676 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed4f3c-2879-4e65-a2e6-b67946362388 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:18:06.065309 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6536b63-a021-49eb-a77d-ec0b87f58e10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:18:06.065918 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6536b63-a021-49eb-a77d-ec0b87f58e10 service nova] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:06.066198 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6536b63-a021-49eb-a77d-ec0b87f58e10 service nova] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:06.066471 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6536b63-a021-49eb-a77d-ec0b87f58e10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:06.074765 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6536b63-a021-49eb-a77d-ec0b87f58e10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:18:06.076444 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6536b63-a021-49eb-a77d-ec0b87f58e10 service nova] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:18:06.086104 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 512/1000] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:18:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:18:08.360300 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cdf78-6c3f-4b14-9b05-b42be3376d8a None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:08.360300 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cdf78-6c3f-4b14-9b05-b42be3376d8a None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:08.361643 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cdf78-6c3f-4b14-9b05-b42be3376d8a None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:08.362709 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 489/1001] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:18:08.368866 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fdf0f-3d17-40d4-b645-6621e1f2be90 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:08.369338 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fdf0f-3d17-40d4-b645-6621e1f2be90 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:08.369445 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fdf0f-3d17-40d4-b645-6621e1f2be90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:08.389278 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-dd7fdf0f-3d17-40d4-b645-6621e1f2be90 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:08.390994 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-dd7fdf0f-3d17-40d4-b645-6621e1f2be90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:08.399124 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 513/1002] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:18:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:18:08.445492 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cdf78-6c3f-4b14-9b05-b42be3376d8a None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:18:08.459576 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cdf78-6c3f-4b14-9b05-b42be3376d8a None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:18:08.464579 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50028e-29e3-446e-aeac-46570f92e448 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:18:08.465191 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50028e-29e3-446e-aeac-46570f92e448 service nova] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:08.465471 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50028e-29e3-446e-aeac-46570f92e448 service nova] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:08.465741 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50028e-29e3-446e-aeac-46570f92e448 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:08.474760 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50028e-29e3-446e-aeac-46570f92e448 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:18:08.476316 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50028e-29e3-446e-aeac-46570f92e448 service nova] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:18:08.486085 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 490/1003] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:18:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:18:10.766809 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ccf9f-a687-424a-8c21-f4d1dfcb977d None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:10.767396 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ccf9f-a687-424a-8c21-f4d1dfcb977d None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:10.767396 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ccf9f-a687-424a-8c21-f4d1dfcb977d None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:10.768711 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 514/1004] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 20:18:10.773840 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6f636-af55-4bfd-9bf0-41a63553adc1 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:10.774256 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6f636-af55-4bfd-9bf0-41a63553adc1 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:10.774390 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6f636-af55-4bfd-9bf0-41a63553adc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:10.793703 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-97d6f636-af55-4bfd-9bf0-41a63553adc1 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:10.795177 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-97d6f636-af55-4bfd-9bf0-41a63553adc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:10.805668 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 491/1005] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:18:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:18:10.848668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ccf9f-a687-424a-8c21-f4d1dfcb977d None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:18:10.862799 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ccf9f-a687-424a-8c21-f4d1dfcb977d None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:18:10.868930 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d43bb2-92cd-4e32-8fe5-6f6945044fa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:18:10.869587 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d43bb2-92cd-4e32-8fe5-6f6945044fa5 service nova] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:10.869871 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d43bb2-92cd-4e32-8fe5-6f6945044fa5 service nova] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:10.870139 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d43bb2-92cd-4e32-8fe5-6f6945044fa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:10.879135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d43bb2-92cd-4e32-8fe5-6f6945044fa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:18:10.880671 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d43bb2-92cd-4e32-8fe5-6f6945044fa5 service nova] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:18:10.890339 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 515/1006] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:18:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:18:13.143299 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79981ea1-9976-4c38-a0f3-c1ec28be327b None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:13.143826 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79981ea1-9976-4c38-a0f3-c1ec28be327b None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:13.143826 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79981ea1-9976-4c38-a0f3-c1ec28be327b None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:13.145595 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 492/1007] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:18:13.150312 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2349226-0fae-4080-bbe7-ba7a96480f00 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:13.150733 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2349226-0fae-4080-bbe7-ba7a96480f00 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:13.150862 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2349226-0fae-4080-bbe7-ba7a96480f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:13.169705 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-f2349226-0fae-4080-bbe7-ba7a96480f00 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:13.171214 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-f2349226-0fae-4080-bbe7-ba7a96480f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:13.179348 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 516/1008] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:18:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:18:13.225399 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79981ea1-9976-4c38-a0f3-c1ec28be327b None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:18:13.239463 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79981ea1-9976-4c38-a0f3-c1ec28be327b None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:18:13.245780 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a88c91-472d-4bea-81d6-49ff4e1d78a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:18:13.246434 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a88c91-472d-4bea-81d6-49ff4e1d78a7 service nova] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:13.246910 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a88c91-472d-4bea-81d6-49ff4e1d78a7 service nova] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:13.247196 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a88c91-472d-4bea-81d6-49ff4e1d78a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:13.261031 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a88c91-472d-4bea-81d6-49ff4e1d78a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:18:13.262621 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a88c91-472d-4bea-81d6-49ff4e1d78a7 service nova] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:18:13.273584 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 493/1009] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:18:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:18:15.556898 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dd8b3-072c-41bf-8fc3-efd840b9504b None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:15.557708 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dd8b3-072c-41bf-8fc3-efd840b9504b None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:15.557708 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dd8b3-072c-41bf-8fc3-efd840b9504b None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:15.558787 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 517/1010] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:18:15.564767 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b616e-e9a8-4443-b482-01f6516bfa53 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:15.565315 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b616e-e9a8-4443-b482-01f6516bfa53 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:15.565315 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b616e-e9a8-4443-b482-01f6516bfa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:15.584139 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-b89b616e-e9a8-4443-b482-01f6516bfa53 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:15.585186 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-b89b616e-e9a8-4443-b482-01f6516bfa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:15.592907 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 494/1011] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:18:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:18:15.639017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213dd8b3-072c-41bf-8fc3-efd840b9504b None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:18:15.657742 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213dd8b3-072c-41bf-8fc3-efd840b9504b None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:18:15.664542 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a0ed9-9ac9-4254-874a-0a6b45e7af31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:18:15.665416 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a0ed9-9ac9-4254-874a-0a6b45e7af31 service nova] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:15.665971 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a0ed9-9ac9-4254-874a-0a6b45e7af31 service nova] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:15.666338 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a0ed9-9ac9-4254-874a-0a6b45e7af31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:15.678613 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a0ed9-9ac9-4254-874a-0a6b45e7af31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:18:15.680860 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a0ed9-9ac9-4254-874a-0a6b45e7af31 service nova] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:18:15.693245 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 518/1012] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:18:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:18:18.147413 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe833ac-761f-4ac6-bd8b-f81a837af2e5 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:18.147413 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe833ac-761f-4ac6-bd8b-f81a837af2e5 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:18.150057 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe833ac-761f-4ac6-bd8b-f81a837af2e5 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:18.150057 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 495/1013] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 20:18:18.154837 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2c4d7-3bd3-4dce-a079-2663206565df None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:18.156283 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2c4d7-3bd3-4dce-a079-2663206565df None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:18.156717 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2c4d7-3bd3-4dce-a079-2663206565df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:18.176884 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-a4f2c4d7-3bd3-4dce-a079-2663206565df None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:18.178013 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-a4f2c4d7-3bd3-4dce-a079-2663206565df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:18.186590 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 519/1014] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:18:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 20:18:18.232315 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe833ac-761f-4ac6-bd8b-f81a837af2e5 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:18:18.247249 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe833ac-761f-4ac6-bd8b-f81a837af2e5 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:18:18.253709 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471bd919-22a5-4435-ba77-28f90ea8b2bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:18:18.254329 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bd919-22a5-4435-ba77-28f90ea8b2bb service nova] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:18.254607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bd919-22a5-4435-ba77-28f90ea8b2bb service nova] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:18.254877 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bd919-22a5-4435-ba77-28f90ea8b2bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:18.264272 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471bd919-22a5-4435-ba77-28f90ea8b2bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:18:18.265929 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471bd919-22a5-4435-ba77-28f90ea8b2bb service nova] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:18:18.283100 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 496/1015] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:18:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:18:20.978755 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc414ff4-bc5b-42d2-972d-af4c45d5a703 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:20.979496 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc414ff4-bc5b-42d2-972d-af4c45d5a703 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:20.979496 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc414ff4-bc5b-42d2-972d-af4c45d5a703 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:20.980875 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 520/1016] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:18:20.985920 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3c6d3-0813-43bf-b1e3-9b811f16ad62 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:20.986378 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3c6d3-0813-43bf-b1e3-9b811f16ad62 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:20.986485 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3c6d3-0813-43bf-b1e3-9b811f16ad62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:21.006027 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-bce3c6d3-0813-43bf-b1e3-9b811f16ad62 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:21.007236 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-bce3c6d3-0813-43bf-b1e3-9b811f16ad62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:21.015288 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 497/1017] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:18:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:18:21.059587 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc414ff4-bc5b-42d2-972d-af4c45d5a703 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:18:21.066857 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=49 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:18:21.073943 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc414ff4-bc5b-42d2-972d-af4c45d5a703 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:18:21.079458 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f5ecf-0bf3-4f3a-9eb7-31c0130a31da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:18:21.080058 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f5ecf-0bf3-4f3a-9eb7-31c0130a31da service nova] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:21.080337 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f5ecf-0bf3-4f3a-9eb7-31c0130a31da service nova] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:21.080611 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f5ecf-0bf3-4f3a-9eb7-31c0130a31da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:21.088790 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f5ecf-0bf3-4f3a-9eb7-31c0130a31da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:18:21.090379 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f5ecf-0bf3-4f3a-9eb7-31c0130a31da service nova] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:18:21.100404 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 521/1018] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:18:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:18:21.698356 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07277424-e21b-47ca-be23-52d8857635e9 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:21.698563 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07277424-e21b-47ca-be23-52d8857635e9 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:21.698873 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07277424-e21b-47ca-be23-52d8857635e9 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:21.700228 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 498/1019] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:18:21.705524 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb6a29-0c4f-4bb4-8684-64e32c5ed34f None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:21.705806 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb6a29-0c4f-4bb4-8684-64e32c5ed34f None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:21.706075 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb6a29-0c4f-4bb4-8684-64e32c5ed34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:21.724539 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-fbeb6a29-0c4f-4bb4-8684-64e32c5ed34f None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:21.725710 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-fbeb6a29-0c4f-4bb4-8684-64e32c5ed34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:21.734593 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 522/1020] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:18:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:18:21.790871 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9e3d0-1fa6-4fe9-90fb-066fb0704d9d None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:21.791271 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9e3d0-1fa6-4fe9-90fb-066fb0704d9d None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:21.791608 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9e3d0-1fa6-4fe9-90fb-066fb0704d9d None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:21.793015 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 499/1021] 10.222.0.83 () {54 vars in 966 bytes} [Wed Jul 27 20:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:18:21.798517 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328abea-5ede-4bab-b331-21d2e6772fe9 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:21.798880 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328abea-5ede-4bab-b331-21d2e6772fe9 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:21.799280 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328abea-5ede-4bab-b331-21d2e6772fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:21.836313 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-8328abea-5ede-4bab-b331-21d2e6772fe9 None None] MFA Rules not processed for user `04dc74146aed49cb98441ea945847379`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:21.837522 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-8328abea-5ede-4bab-b331-21d2e6772fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:21.896576 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 523/1022] 10.222.0.83 () {58 vars in 1063 bytes} [Wed Jul 27 20:18:21 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:18:21.903937 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9e3d0-1fa6-4fe9-90fb-066fb0704d9d None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:18:21.914393 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9e3d0-1fa6-4fe9-90fb-066fb0704d9d None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:18:21.917909 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d8c12-b4c6-4d11-82e2-4e6d8b04b1e1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04dc74146aed49cb98441ea945847379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:18:21.918509 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d8c12-b4c6-4d11-82e2-4e6d8b04b1e1 service glance] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:21.918789 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d8c12-b4c6-4d11-82e2-4e6d8b04b1e1 service glance] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:21.919061 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d8c12-b4c6-4d11-82e2-4e6d8b04b1e1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:21.928973 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d8c12-b4c6-4d11-82e2-4e6d8b04b1e1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:18:21.930406 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d8c12-b4c6-4d11-82e2-4e6d8b04b1e1 service glance] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:18:21.940506 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 500/1023] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:18:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:18:23.384323 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64374933-b2b2-45a4-ab49-04dc16fbdcfb None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:23.384937 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64374933-b2b2-45a4-ab49-04dc16fbdcfb None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:23.384937 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64374933-b2b2-45a4-ab49-04dc16fbdcfb None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:23.386226 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 524/1024] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:18:23.391548 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a43a19-b3ef-4181-9f29-92fbb7f7af58 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:23.392057 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a43a19-b3ef-4181-9f29-92fbb7f7af58 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:23.392177 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a43a19-b3ef-4181-9f29-92fbb7f7af58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:23.416224 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-39a43a19-b3ef-4181-9f29-92fbb7f7af58 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:23.417459 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-39a43a19-b3ef-4181-9f29-92fbb7f7af58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:23.425924 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 501/1025] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:18:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:18:23.472053 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64374933-b2b2-45a4-ab49-04dc16fbdcfb None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:18:23.487153 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64374933-b2b2-45a4-ab49-04dc16fbdcfb None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:18:23.492070 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c816f4-a7eb-4324-9dbb-bddeaa29501f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:18:23.492693 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c816f4-a7eb-4324-9dbb-bddeaa29501f service nova] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:23.492974 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c816f4-a7eb-4324-9dbb-bddeaa29501f service nova] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:23.493221 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c816f4-a7eb-4324-9dbb-bddeaa29501f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:23.502845 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c816f4-a7eb-4324-9dbb-bddeaa29501f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:18:23.504723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c816f4-a7eb-4324-9dbb-bddeaa29501f service nova] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:18:23.514385 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 525/1026] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:18:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:18:33.405973 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=37 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:18:33.510064 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=47 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:18:37.127443 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e08328-146f-40e6-ac15-ea397f3809bf None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:37.128388 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e08328-146f-40e6-ac15-ea397f3809bf None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:37.128388 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e08328-146f-40e6-ac15-ea397f3809bf None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:37.129572 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 502/1027] 10.222.0.83 () {54 vars in 918 bytes} [Wed Jul 27 20:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 20:18:37.134756 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134709d-c9e5-456c-a91c-d2adab6b2f44 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:37.135306 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134709d-c9e5-456c-a91c-d2adab6b2f44 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:37.135417 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134709d-c9e5-456c-a91c-d2adab6b2f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:37.154732 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-a134709d-c9e5-456c-a91c-d2adab6b2f44 None None] MFA Rules not processed for user `733839729aa249e0823f24a8e8fb3ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:37.157040 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-a134709d-c9e5-456c-a91c-d2adab6b2f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:37.165541 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 526/1028] 10.222.0.83 () {58 vars in 1015 bytes} [Wed Jul 27 20:18:37 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:18:37.180022 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa0905-9533-49a0-87b2-8ab2a8115188 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:37.180302 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa0905-9533-49a0-87b2-8ab2a8115188 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:37.180574 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa0905-9533-49a0-87b2-8ab2a8115188 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:37.181877 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 503/1029] 10.222.0.83 () {54 vars in 918 bytes} [Wed Jul 27 20:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:18:37.186195 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943136f-3d0e-47ef-aca7-f6637febff9d None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:37.186481 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943136f-3d0e-47ef-aca7-f6637febff9d None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:37.186756 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943136f-3d0e-47ef-aca7-f6637febff9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:37.205541 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-4943136f-3d0e-47ef-aca7-f6637febff9d None None] MFA Rules not processed for user `f68b37524d7245e4b606ad8dd15442ef`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:37.206746 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-4943136f-3d0e-47ef-aca7-f6637febff9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:37.215122 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 527/1030] 10.222.0.83 () {58 vars in 1015 bytes} [Wed Jul 27 20:18:37 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:18:39.945434 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6642fab-6403-42a6-9f44-bf3898cbc558 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:39.946024 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6642fab-6403-42a6-9f44-bf3898cbc558 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:39.946024 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6642fab-6403-42a6-9f44-bf3898cbc558 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:39.947451 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 504/1031] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 20:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:18:39.955007 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b9d1f-8545-4962-93e4-d5dbe9362b75 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:39.955493 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b9d1f-8545-4962-93e4-d5dbe9362b75 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:39.955608 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b9d1f-8545-4962-93e4-d5dbe9362b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:39.974136 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-0c3b9d1f-8545-4962-93e4-d5dbe9362b75 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:39.975356 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-0c3b9d1f-8545-4962-93e4-d5dbe9362b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:39.982924 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 528/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 20:18:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:18:40.027285 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6642fab-6403-42a6-9f44-bf3898cbc558 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:18:40.041547 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6642fab-6403-42a6-9f44-bf3898cbc558 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:18:40.048798 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892628f3-90e8-4e71-a983-f02f4e040686 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:18:40.049403 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892628f3-90e8-4e71-a983-f02f4e040686 service nova] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:40.049683 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892628f3-90e8-4e71-a983-f02f4e040686 service nova] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:40.049955 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892628f3-90e8-4e71-a983-f02f4e040686 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:40.058038 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892628f3-90e8-4e71-a983-f02f4e040686 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:18:40.059640 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892628f3-90e8-4e71-a983-f02f4e040686 service nova] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:18:40.069282 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 505/1033] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:18:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:18:41.035236 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb0f60-3225-4ced-9cbf-336494588486 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:41.035809 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb0f60-3225-4ced-9cbf-336494588486 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:41.035809 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb0f60-3225-4ced-9cbf-336494588486 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:41.037106 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 529/1034] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 20:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:18:41.041890 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b85030-6345-4b2a-a0e0-47dbcf846886 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:41.042288 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b85030-6345-4b2a-a0e0-47dbcf846886 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:41.042433 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b85030-6345-4b2a-a0e0-47dbcf846886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:41.061932 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-d4b85030-6345-4b2a-a0e0-47dbcf846886 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:41.063155 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-d4b85030-6345-4b2a-a0e0-47dbcf846886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:41.070785 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 506/1035] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 20:18:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:18:41.255675 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb0f60-3225-4ced-9cbf-336494588486 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:18:41.269404 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb0f60-3225-4ced-9cbf-336494588486 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:18:41.274339 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d252f-da14-48df-8e29-5f1461c4bef3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:18:41.274939 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d252f-da14-48df-8e29-5f1461c4bef3 service nova] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:41.275252 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d252f-da14-48df-8e29-5f1461c4bef3 service nova] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:41.275526 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d252f-da14-48df-8e29-5f1461c4bef3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:41.284116 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d252f-da14-48df-8e29-5f1461c4bef3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:18:41.285756 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d252f-da14-48df-8e29-5f1461c4bef3 service nova] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:18:41.294964 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 530/1036] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:18:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:18:42.196517 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dde14-8dee-449c-b9ec-b0a3e44cd294 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:42.197092 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dde14-8dee-449c-b9ec-b0a3e44cd294 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:42.197092 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dde14-8dee-449c-b9ec-b0a3e44cd294 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:42.198407 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 507/1037] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 20:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:18:42.203480 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e18b2-a7e7-4c2d-947e-fe78aa036315 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:42.203908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e18b2-a7e7-4c2d-947e-fe78aa036315 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:42.204046 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e18b2-a7e7-4c2d-947e-fe78aa036315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:42.223214 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-ab1e18b2-a7e7-4c2d-947e-fe78aa036315 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:42.224387 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-ab1e18b2-a7e7-4c2d-947e-fe78aa036315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:42.231962 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 531/1038] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 20:18:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:18:42.385948 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dde14-8dee-449c-b9ec-b0a3e44cd294 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:18:42.399321 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dde14-8dee-449c-b9ec-b0a3e44cd294 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:18:42.404149 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41cc08-7113-4b06-9906-b3a18ea1ca33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:18:42.404779 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41cc08-7113-4b06-9906-b3a18ea1ca33 service nova] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:42.405057 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41cc08-7113-4b06-9906-b3a18ea1ca33 service nova] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:42.405325 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41cc08-7113-4b06-9906-b3a18ea1ca33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:42.414237 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41cc08-7113-4b06-9906-b3a18ea1ca33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:18:42.415878 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41cc08-7113-4b06-9906-b3a18ea1ca33 service nova] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:18:42.426518 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 508/1039] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:18:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:18:43.278296 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bea60-4847-40ce-8dca-d3db6e41e5bb None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:43.278856 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bea60-4847-40ce-8dca-d3db6e41e5bb None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:43.278856 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bea60-4847-40ce-8dca-d3db6e41e5bb None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:43.280280 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 532/1040] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 20:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:18:43.285145 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba691f-73da-412a-9ed3-7fee7e0b6439 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:43.285592 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba691f-73da-412a-9ed3-7fee7e0b6439 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:43.285695 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba691f-73da-412a-9ed3-7fee7e0b6439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:43.305185 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-30ba691f-73da-412a-9ed3-7fee7e0b6439 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:43.306378 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-30ba691f-73da-412a-9ed3-7fee7e0b6439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:43.314946 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 509/1041] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 20:18:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:18:43.476349 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3bea60-4847-40ce-8dca-d3db6e41e5bb None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:18:43.490096 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3bea60-4847-40ce-8dca-d3db6e41e5bb None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:18:43.494985 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca17d64-772c-4f91-afc8-f2c3b01c30ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:18:43.495615 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca17d64-772c-4f91-afc8-f2c3b01c30ed service nova] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:43.495896 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca17d64-772c-4f91-afc8-f2c3b01c30ed service nova] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:43.496171 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca17d64-772c-4f91-afc8-f2c3b01c30ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:43.505117 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca17d64-772c-4f91-afc8-f2c3b01c30ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:18:43.506724 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca17d64-772c-4f91-afc8-f2c3b01c30ed service nova] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:18:43.516073 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 533/1042] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:18:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:18:44.384774 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b1230-8d1d-4bb7-b4b8-0f179384cbc3 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:44.385296 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b1230-8d1d-4bb7-b4b8-0f179384cbc3 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:44.385296 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b1230-8d1d-4bb7-b4b8-0f179384cbc3 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:44.386710 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 510/1043] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 20:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:18:44.392023 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede1cd3-4729-41ae-9966-75988f27728d None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:44.392403 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede1cd3-4729-41ae-9966-75988f27728d None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:44.392574 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede1cd3-4729-41ae-9966-75988f27728d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:44.411919 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-2ede1cd3-4729-41ae-9966-75988f27728d None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:44.413107 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-2ede1cd3-4729-41ae-9966-75988f27728d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:44.420812 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 534/1044] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 20:18:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:18:44.577602 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b1230-8d1d-4bb7-b4b8-0f179384cbc3 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:18:44.591409 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b1230-8d1d-4bb7-b4b8-0f179384cbc3 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:18:44.596222 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0c8d7-5f27-4219-b063-2605f3f70f23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:18:44.596821 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0c8d7-5f27-4219-b063-2605f3f70f23 service nova] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:44.597094 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0c8d7-5f27-4219-b063-2605f3f70f23 service nova] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:44.597361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0c8d7-5f27-4219-b063-2605f3f70f23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:44.605243 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0c8d7-5f27-4219-b063-2605f3f70f23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:18:44.606795 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0c8d7-5f27-4219-b063-2605f3f70f23 service nova] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:18:44.615869 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 511/1045] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:18:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:18:45.414737 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2a1ba-c7a3-463e-aac3-f6f379d22581 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:45.415307 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2a1ba-c7a3-463e-aac3-f6f379d22581 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:45.415403 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2a1ba-c7a3-463e-aac3-f6f379d22581 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:45.416719 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 535/1046] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 20:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:18:45.421599 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7afec2-aef7-4e85-9e13-13d43d990d2f None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:45.422015 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7afec2-aef7-4e85-9e13-13d43d990d2f None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:45.422152 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7afec2-aef7-4e85-9e13-13d43d990d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:45.441509 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-dd7afec2-aef7-4e85-9e13-13d43d990d2f None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:45.442702 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-dd7afec2-aef7-4e85-9e13-13d43d990d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:45.450432 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 512/1047] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 20:18:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:18:45.605322 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2a1ba-c7a3-463e-aac3-f6f379d22581 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:18:45.618874 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2a1ba-c7a3-463e-aac3-f6f379d22581 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:18:45.623746 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cb5e8-65d4-49da-820d-682b9679a20b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:18:45.624343 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cb5e8-65d4-49da-820d-682b9679a20b service nova] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:45.624627 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cb5e8-65d4-49da-820d-682b9679a20b service nova] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:45.625562 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cb5e8-65d4-49da-820d-682b9679a20b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:45.634147 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4cb5e8-65d4-49da-820d-682b9679a20b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:18:45.635772 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4cb5e8-65d4-49da-820d-682b9679a20b service nova] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:18:45.645553 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 536/1048] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:18:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:18:46.459253 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bca667-8dec-4a3d-852e-0dd59b6496af None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:46.459809 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bca667-8dec-4a3d-852e-0dd59b6496af None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:46.460224 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bca667-8dec-4a3d-852e-0dd59b6496af None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:46.462652 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 513/1049] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 20:18:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:18:46.468330 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820b819-f4be-4aa3-9171-c350f0bec66a None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:46.468772 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820b819-f4be-4aa3-9171-c350f0bec66a None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:46.468917 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820b819-f4be-4aa3-9171-c350f0bec66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:46.489440 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-c820b819-f4be-4aa3-9171-c350f0bec66a None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:46.490631 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-c820b819-f4be-4aa3-9171-c350f0bec66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:46.498335 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 537/1050] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 20:18:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:18:46.651443 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bca667-8dec-4a3d-852e-0dd59b6496af None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:18:46.665045 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bca667-8dec-4a3d-852e-0dd59b6496af None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:18:46.669886 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2908ed-8d76-4fc8-91bb-abe0c5a20d32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:18:46.670485 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2908ed-8d76-4fc8-91bb-abe0c5a20d32 service nova] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:46.670785 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2908ed-8d76-4fc8-91bb-abe0c5a20d32 service nova] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:46.671054 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2908ed-8d76-4fc8-91bb-abe0c5a20d32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:46.679801 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2908ed-8d76-4fc8-91bb-abe0c5a20d32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:18:46.681370 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2908ed-8d76-4fc8-91bb-abe0c5a20d32 service nova] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:18:46.690494 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 514/1051] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:18:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 20:18:47.496317 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85441108-fcbd-4c2a-94c4-1fd960243aad None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:47.496854 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85441108-fcbd-4c2a-94c4-1fd960243aad None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:47.496854 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85441108-fcbd-4c2a-94c4-1fd960243aad None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:47.498206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 538/1052] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 20:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:18:47.503795 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8600cb-7890-495b-a881-f988829e1e7d None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:47.504488 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8600cb-7890-495b-a881-f988829e1e7d None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:47.504614 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8600cb-7890-495b-a881-f988829e1e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:47.523972 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-0f8600cb-7890-495b-a881-f988829e1e7d None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:47.525150 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-0f8600cb-7890-495b-a881-f988829e1e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:47.532781 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 515/1053] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 20:18:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:18:47.688445 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85441108-fcbd-4c2a-94c4-1fd960243aad None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:18:47.702106 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85441108-fcbd-4c2a-94c4-1fd960243aad None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:18:47.707562 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eae6c7-c57e-4093-a7a5-2efac4370827 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:18:47.708182 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eae6c7-c57e-4093-a7a5-2efac4370827 service nova] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:47.708458 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eae6c7-c57e-4093-a7a5-2efac4370827 service nova] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:47.708723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eae6c7-c57e-4093-a7a5-2efac4370827 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:47.716675 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eae6c7-c57e-4093-a7a5-2efac4370827 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:18:47.718239 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eae6c7-c57e-4093-a7a5-2efac4370827 service nova] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:18:47.727426 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 539/1054] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:18:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:18:48.547615 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bb5aa-9f87-4e7a-aa77-0adc1989e6e8 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:48.548163 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bb5aa-9f87-4e7a-aa77-0adc1989e6e8 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:48.548163 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bb5aa-9f87-4e7a-aa77-0adc1989e6e8 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:48.549502 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 516/1055] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 20:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:18:48.554445 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc76851-07f0-42c0-8ef1-329b4398923e None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:48.554893 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc76851-07f0-42c0-8ef1-329b4398923e None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:48.555005 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc76851-07f0-42c0-8ef1-329b4398923e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:48.574702 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-abc76851-07f0-42c0-8ef1-329b4398923e None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:48.575894 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-abc76851-07f0-42c0-8ef1-329b4398923e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:48.583656 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 540/1056] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 20:18:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:18:48.738499 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bb5aa-9f87-4e7a-aa77-0adc1989e6e8 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:18:48.752772 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bb5aa-9f87-4e7a-aa77-0adc1989e6e8 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:18:48.758705 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de95e47-865c-45a4-a3c7-7cb0abe01c5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:18:48.759362 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de95e47-865c-45a4-a3c7-7cb0abe01c5e service nova] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:48.759648 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de95e47-865c-45a4-a3c7-7cb0abe01c5e service nova] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:48.760143 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de95e47-865c-45a4-a3c7-7cb0abe01c5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:48.769570 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de95e47-865c-45a4-a3c7-7cb0abe01c5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:18:48.771198 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de95e47-865c-45a4-a3c7-7cb0abe01c5e service nova] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:18:48.783343 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 517/1057] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:18:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:18:50.872426 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2259b2-578b-4e73-8beb-2c7b4794be34 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:50.872984 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2259b2-578b-4e73-8beb-2c7b4794be34 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:50.872984 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2259b2-578b-4e73-8beb-2c7b4794be34 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:50.874323 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 541/1058] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 20:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:18:50.880505 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8ab10-d536-484b-944b-8da0ce810abe None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:50.880909 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8ab10-d536-484b-944b-8da0ce810abe None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:50.881045 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8ab10-d536-484b-944b-8da0ce810abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:50.900004 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-b4c8ab10-d536-484b-944b-8da0ce810abe None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:50.901229 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-b4c8ab10-d536-484b-944b-8da0ce810abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:50.908746 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 518/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 20:18:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:18:50.948610 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2259b2-578b-4e73-8beb-2c7b4794be34 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:18:50.959418 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2259b2-578b-4e73-8beb-2c7b4794be34 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:18:50.962888 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081d558-1ce5-4393-a30d-0b9d3a0c8161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:18:50.963515 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081d558-1ce5-4393-a30d-0b9d3a0c8161 service neutron] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:50.963794 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081d558-1ce5-4393-a30d-0b9d3a0c8161 service neutron] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:50.964065 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081d558-1ce5-4393-a30d-0b9d3a0c8161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:50.972662 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081d558-1ce5-4393-a30d-0b9d3a0c8161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:18:50.974116 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081d558-1ce5-4393-a30d-0b9d3a0c8161 service neutron] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:18:50.983426 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 542/1060] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:18:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:18:53.314337 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505158c-7f6a-49ce-a5af-c6ab27686919 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:53.314892 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505158c-7f6a-49ce-a5af-c6ab27686919 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:53.314892 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505158c-7f6a-49ce-a5af-c6ab27686919 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:53.316240 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 519/1061] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 20:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:18:53.321427 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827f71a-14e2-4846-9023-7b981a326f04 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:53.321850 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827f71a-14e2-4846-9023-7b981a326f04 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:53.321956 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827f71a-14e2-4846-9023-7b981a326f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:53.341000 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-6827f71a-14e2-4846-9023-7b981a326f04 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:53.342184 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-6827f71a-14e2-4846-9023-7b981a326f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:53.350477 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 543/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 20:18:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 20:18:53.389996 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505158c-7f6a-49ce-a5af-c6ab27686919 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:18:53.401148 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505158c-7f6a-49ce-a5af-c6ab27686919 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:18:53.404605 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b06513-bceb-4742-a31e-d08d7af823d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:18:53.405204 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b06513-bceb-4742-a31e-d08d7af823d1 service neutron] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:53.405485 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b06513-bceb-4742-a31e-d08d7af823d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:53.405758 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b06513-bceb-4742-a31e-d08d7af823d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:53.415105 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b06513-bceb-4742-a31e-d08d7af823d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:18:53.416534 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b06513-bceb-4742-a31e-d08d7af823d1 service neutron] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:18:53.425904 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 520/1063] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:18:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:18:55.941365 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6616d08-5f87-410b-8261-44a203c23f44 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:55.941939 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6616d08-5f87-410b-8261-44a203c23f44 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:55.941939 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6616d08-5f87-410b-8261-44a203c23f44 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:55.943287 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 544/1064] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 20:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:18:55.948420 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71595627-0e87-43a9-8077-bb835e6c05ed None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:55.949036 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71595627-0e87-43a9-8077-bb835e6c05ed None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:55.949036 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71595627-0e87-43a9-8077-bb835e6c05ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:55.967669 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-71595627-0e87-43a9-8077-bb835e6c05ed None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:55.968866 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-71595627-0e87-43a9-8077-bb835e6c05ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:55.977106 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 521/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 20:18:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:18:56.016968 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6616d08-5f87-410b-8261-44a203c23f44 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:18:56.027376 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6616d08-5f87-410b-8261-44a203c23f44 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:18:56.030758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115955b8-f9dd-4228-804a-ec88d4eeb175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:18:56.031387 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115955b8-f9dd-4228-804a-ec88d4eeb175 service neutron] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:56.032299 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115955b8-f9dd-4228-804a-ec88d4eeb175 service neutron] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:56.032572 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115955b8-f9dd-4228-804a-ec88d4eeb175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:56.041070 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115955b8-f9dd-4228-804a-ec88d4eeb175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:18:56.042491 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115955b8-f9dd-4228-804a-ec88d4eeb175 service neutron] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:18:56.056233 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 545/1066] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:18:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:18:58.394733 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3ea08-0408-45d2-af49-6ce9d0bb94f9 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:58.395294 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3ea08-0408-45d2-af49-6ce9d0bb94f9 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:58.395294 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3ea08-0408-45d2-af49-6ce9d0bb94f9 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:58.396667 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 522/1067] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 20:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:18:58.402056 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fef9d1-3737-4980-a894-b10105a37bef None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:58.402492 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fef9d1-3737-4980-a894-b10105a37bef None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:58.402719 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fef9d1-3737-4980-a894-b10105a37bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:58.422979 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-d4fef9d1-3737-4980-a894-b10105a37bef None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:18:58.424206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-d4fef9d1-3737-4980-a894-b10105a37bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:18:58.431908 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 546/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 20:18:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:18:58.470617 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3ea08-0408-45d2-af49-6ce9d0bb94f9 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:18:58.481280 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3ea08-0408-45d2-af49-6ce9d0bb94f9 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:18:58.485249 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92425ac-0daf-44b4-a3af-d64f7f1f5b8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:18:58.485849 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92425ac-0daf-44b4-a3af-d64f7f1f5b8e service neutron] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:18:58.486125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92425ac-0daf-44b4-a3af-d64f7f1f5b8e service neutron] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:18:58.486391 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92425ac-0daf-44b4-a3af-d64f7f1f5b8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:18:58.495021 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92425ac-0daf-44b4-a3af-d64f7f1f5b8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:18:58.496471 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92425ac-0daf-44b4-a3af-d64f7f1f5b8e service neutron] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:18:58.506587 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 523/1069] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:18:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:19:00.800978 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395ef00-0cb2-4c3a-9d6a-1aa7c737db93 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:00.801755 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395ef00-0cb2-4c3a-9d6a-1aa7c737db93 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:00.801755 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395ef00-0cb2-4c3a-9d6a-1aa7c737db93 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:00.803182 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 547/1070] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 20:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:19:00.808616 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc35ef-c7f9-4bcc-ad7f-82fde21ce2c4 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:00.809025 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc35ef-c7f9-4bcc-ad7f-82fde21ce2c4 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:00.809149 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc35ef-c7f9-4bcc-ad7f-82fde21ce2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:00.827590 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-81cc35ef-c7f9-4bcc-ad7f-82fde21ce2c4 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:19:00.829302 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-81cc35ef-c7f9-4bcc-ad7f-82fde21ce2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:19:00.836914 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 524/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 20:19:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:19:00.876037 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395ef00-0cb2-4c3a-9d6a-1aa7c737db93 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:19:00.886723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395ef00-0cb2-4c3a-9d6a-1aa7c737db93 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:19:00.890206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590a624-92b8-4045-b867-4333d18e1954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:19:00.891322 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590a624-92b8-4045-b867-4333d18e1954 service neutron] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:00.891621 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590a624-92b8-4045-b867-4333d18e1954 service neutron] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:00.891880 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590a624-92b8-4045-b867-4333d18e1954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:00.901076 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590a624-92b8-4045-b867-4333d18e1954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:19:00.902495 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590a624-92b8-4045-b867-4333d18e1954 service neutron] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:19:00.912431 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 548/1072] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:19:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:19:03.163719 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118d58d-0a6c-4e95-8e42-eab10283832d None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:03.164239 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118d58d-0a6c-4e95-8e42-eab10283832d None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:03.164239 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118d58d-0a6c-4e95-8e42-eab10283832d None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:03.165643 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 525/1073] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 20:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:19:03.170736 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0f3b2-73d9-4a27-8552-8ab8f673800f None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:03.171166 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0f3b2-73d9-4a27-8552-8ab8f673800f None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:03.171322 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0f3b2-73d9-4a27-8552-8ab8f673800f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:03.190253 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-ecd0f3b2-73d9-4a27-8552-8ab8f673800f None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:19:03.191460 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-ecd0f3b2-73d9-4a27-8552-8ab8f673800f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:19:03.198993 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 549/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 20:19:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:19:03.238019 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118d58d-0a6c-4e95-8e42-eab10283832d None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:19:03.248534 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118d58d-0a6c-4e95-8e42-eab10283832d None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:19:03.252384 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4435b-0884-4327-a83c-1812ddb180ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:19:03.252984 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4435b-0884-4327-a83c-1812ddb180ec service neutron] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:03.253262 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4435b-0884-4327-a83c-1812ddb180ec service neutron] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:03.253536 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4435b-0884-4327-a83c-1812ddb180ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:03.262540 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4435b-0884-4327-a83c-1812ddb180ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:19:03.263986 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4435b-0884-4327-a83c-1812ddb180ec service neutron] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:19:03.273424 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 526/1075] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:19:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:19:05.592111 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b61cb8-0c7a-4b91-ba82-deca4669dd2b None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:05.592626 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b61cb8-0c7a-4b91-ba82-deca4669dd2b None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:05.592626 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b61cb8-0c7a-4b91-ba82-deca4669dd2b None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:05.593979 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 550/1076] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 20:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:19:05.599207 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b4b8f-d04b-4b42-a002-81de89fe83e6 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:05.599584 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b4b8f-d04b-4b42-a002-81de89fe83e6 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:05.599758 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b4b8f-d04b-4b42-a002-81de89fe83e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:05.607061 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=70 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:19:05.619662 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-137b4b8f-d04b-4b42-a002-81de89fe83e6 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:19:05.620839 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-137b4b8f-d04b-4b42-a002-81de89fe83e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:19:05.628896 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 527/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 20:19:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:19:05.667803 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b61cb8-0c7a-4b91-ba82-deca4669dd2b None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:19:05.673145 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=73 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:19:05.679628 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b61cb8-0c7a-4b91-ba82-deca4669dd2b None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:19:05.683080 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601bc37-b762-4eea-903d-fffa3227dbd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:19:05.683710 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601bc37-b762-4eea-903d-fffa3227dbd6 service neutron] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:05.683989 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601bc37-b762-4eea-903d-fffa3227dbd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:05.684264 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601bc37-b762-4eea-903d-fffa3227dbd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:05.696199 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601bc37-b762-4eea-903d-fffa3227dbd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:19:05.697637 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601bc37-b762-4eea-903d-fffa3227dbd6 service neutron] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:19:05.707685 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 551/1078] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:19:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:19:07.971560 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c89874-dd65-47e1-bb02-4445feed319f None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:07.972153 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c89874-dd65-47e1-bb02-4445feed319f None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:07.972153 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c89874-dd65-47e1-bb02-4445feed319f None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:07.973443 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 528/1079] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 20:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:19:07.978567 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a190e-d383-483b-a5a8-27d261c00c11 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:07.978986 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a190e-d383-483b-a5a8-27d261c00c11 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:07.979140 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a190e-d383-483b-a5a8-27d261c00c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:07.998072 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-ff8a190e-d383-483b-a5a8-27d261c00c11 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:19:07.999304 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-ff8a190e-d383-483b-a5a8-27d261c00c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:19:08.007216 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 552/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 20:19:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:19:08.046213 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c89874-dd65-47e1-bb02-4445feed319f None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:19:08.056574 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c89874-dd65-47e1-bb02-4445feed319f None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:19:08.059990 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adfbf6-bd43-41ba-8e51-80c9e0391896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:19:08.060584 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adfbf6-bd43-41ba-8e51-80c9e0391896 service neutron] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:08.060859 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adfbf6-bd43-41ba-8e51-80c9e0391896 service neutron] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:08.061125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adfbf6-bd43-41ba-8e51-80c9e0391896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:08.069850 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adfbf6-bd43-41ba-8e51-80c9e0391896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:19:08.071293 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adfbf6-bd43-41ba-8e51-80c9e0391896 service neutron] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:19:08.080824 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 529/1081] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:19:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:19:10.302798 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ab326-c239-45fc-ab8e-4dbfc2bcecd2 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:10.303377 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ab326-c239-45fc-ab8e-4dbfc2bcecd2 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:10.303377 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ab326-c239-45fc-ab8e-4dbfc2bcecd2 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:10.304738 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 553/1082] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 20:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:19:10.309965 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82b561-5983-48a4-90ff-da0f8ccb29fd None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:10.310373 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82b561-5983-48a4-90ff-da0f8ccb29fd None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:10.310546 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82b561-5983-48a4-90ff-da0f8ccb29fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:10.330712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-0a82b561-5983-48a4-90ff-da0f8ccb29fd None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:19:10.331943 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-0a82b561-5983-48a4-90ff-da0f8ccb29fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:19:10.339732 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 530/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 20:19:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:19:10.377506 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ab326-c239-45fc-ab8e-4dbfc2bcecd2 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:19:10.388322 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ab326-c239-45fc-ab8e-4dbfc2bcecd2 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:19:10.391786 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cbe982-634b-4b1c-8e79-7d2275209287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:19:10.392379 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbe982-634b-4b1c-8e79-7d2275209287 service neutron] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:10.392652 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbe982-634b-4b1c-8e79-7d2275209287 service neutron] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:10.392918 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbe982-634b-4b1c-8e79-7d2275209287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:10.401577 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cbe982-634b-4b1c-8e79-7d2275209287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:19:10.402994 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cbe982-634b-4b1c-8e79-7d2275209287 service neutron] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:19:10.412175 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 554/1084] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:19:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:19:12.617039 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714d668-f62f-4d3f-8d25-56d9d251d8b8 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:12.617565 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714d668-f62f-4d3f-8d25-56d9d251d8b8 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:12.617565 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714d668-f62f-4d3f-8d25-56d9d251d8b8 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:12.618851 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 531/1085] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 20:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:19:12.623958 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1852ac0-eddc-49e5-b376-ba621930a8e9 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:12.624381 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1852ac0-eddc-49e5-b376-ba621930a8e9 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:12.624564 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1852ac0-eddc-49e5-b376-ba621930a8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:12.643985 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-a1852ac0-eddc-49e5-b376-ba621930a8e9 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:19:12.645158 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-a1852ac0-eddc-49e5-b376-ba621930a8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:19:12.652767 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 555/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 20:19:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:19:12.690182 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714d668-f62f-4d3f-8d25-56d9d251d8b8 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:19:12.700694 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714d668-f62f-4d3f-8d25-56d9d251d8b8 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:19:12.704857 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54f946-389b-40f8-83b8-c3518ab7712e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:19:12.705464 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54f946-389b-40f8-83b8-c3518ab7712e service neutron] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:12.705744 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54f946-389b-40f8-83b8-c3518ab7712e service neutron] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:12.706015 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54f946-389b-40f8-83b8-c3518ab7712e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:12.715190 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54f946-389b-40f8-83b8-c3518ab7712e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:19:12.716613 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54f946-389b-40f8-83b8-c3518ab7712e service neutron] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:19:12.726526 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 532/1087] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:19:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:19:22.638814 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=17 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:19:22.722330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=17 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:19:36.240186 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5101d91-8ba5-4896-b2e1-25fc6ffe0494 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:36.240753 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5101d91-8ba5-4896-b2e1-25fc6ffe0494 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:36.240753 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5101d91-8ba5-4896-b2e1-25fc6ffe0494 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:36.242051 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 556/1088] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:19:36.247352 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d2b1c-0dd8-482a-90f7-d0019050862d None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:36.247756 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d2b1c-0dd8-482a-90f7-d0019050862d None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:36.247905 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d2b1c-0dd8-482a-90f7-d0019050862d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:36.267776 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-6d5d2b1c-0dd8-482a-90f7-d0019050862d None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:19:36.268955 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-6d5d2b1c-0dd8-482a-90f7-d0019050862d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:19:36.276587 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 533/1089] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:19:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:19:36.325879 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811846b1-6bd9-4650-9692-89f601b527fb None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:36.326160 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811846b1-6bd9-4650-9692-89f601b527fb None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:36.326429 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811846b1-6bd9-4650-9692-89f601b527fb None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:36.328444 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 557/1090] 10.222.0.83 () {54 vars in 966 bytes} [Wed Jul 27 20:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:19:36.333673 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5f603-0a8e-47ed-a2b0-6d864e8834fa None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:36.333960 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5f603-0a8e-47ed-a2b0-6d864e8834fa None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:36.334238 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5f603-0a8e-47ed-a2b0-6d864e8834fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:36.353814 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-f6b5f603-0a8e-47ed-a2b0-6d864e8834fa None None] MFA Rules not processed for user `04dc74146aed49cb98441ea945847379`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:19:36.354993 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-f6b5f603-0a8e-47ed-a2b0-6d864e8834fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:19:36.361330 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 534/1091] 10.222.0.83 () {58 vars in 1063 bytes} [Wed Jul 27 20:19:36 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:19:36.368440 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811846b1-6bd9-4650-9692-89f601b527fb None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:19:36.379146 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811846b1-6bd9-4650-9692-89f601b527fb None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:19:36.382763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd6e7d-ec01-4d33-a129-aebb508be135 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04dc74146aed49cb98441ea945847379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:19:36.383386 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd6e7d-ec01-4d33-a129-aebb508be135 service glance] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:36.383660 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd6e7d-ec01-4d33-a129-aebb508be135 service glance] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:36.383931 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd6e7d-ec01-4d33-a129-aebb508be135 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:36.393341 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd6e7d-ec01-4d33-a129-aebb508be135 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:19:36.394750 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd6e7d-ec01-4d33-a129-aebb508be135 service glance] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:19:36.403760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 558/1092] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:19:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:19:38.712323 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16bce8-c720-472e-84b3-f1760c22d88f None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:38.712831 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16bce8-c720-472e-84b3-f1760c22d88f None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:38.712934 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16bce8-c720-472e-84b3-f1760c22d88f None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:38.714200 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 535/1093] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:19:38.719573 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c43bb-0f3a-4744-8dfc-ad684f158edb None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:38.720013 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c43bb-0f3a-4744-8dfc-ad684f158edb None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:38.720128 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c43bb-0f3a-4744-8dfc-ad684f158edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:38.738423 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-380c43bb-0f3a-4744-8dfc-ad684f158edb None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:19:38.739631 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-380c43bb-0f3a-4744-8dfc-ad684f158edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:19:38.747243 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 559/1094] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:19:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:19:38.771884 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16bce8-c720-472e-84b3-f1760c22d88f None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:19:38.784040 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16bce8-c720-472e-84b3-f1760c22d88f None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:19:38.788384 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b29ee-9fea-4229-b293-5dbd7842749b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:19:38.788974 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b29ee-9fea-4229-b293-5dbd7842749b admin admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:38.789251 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b29ee-9fea-4229-b293-5dbd7842749b admin admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:38.789523 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b29ee-9fea-4229-b293-5dbd7842749b admin admin] PATH_INFO: `/v3/projects` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:38.790206 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b29ee-9fea-4229-b293-5dbd7842749b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:19:38.791969 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: WARNING py.warnings [None req-2f4b29ee-9fea-4229-b293-5dbd7842749b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:19:38.791969 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: warnings.warn(msg) Jul 27 20:19:38.791969 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: Jul 27 20:19:38.793118 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b29ee-9fea-4229-b293-5dbd7842749b admin admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:19:38.811026 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 536/1095] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 27 20:19:38 2022] GET /identity/v3/projects => generated 1606 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 20:19:41.120826 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5205012-5bea-4d8e-be4a-96414d22309d None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:41.121382 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5205012-5bea-4d8e-be4a-96414d22309d None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:41.121382 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5205012-5bea-4d8e-be4a-96414d22309d None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:41.122694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 560/1096] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:19:41.128003 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e1a91-8974-4b65-941e-b013ce8b94d2 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:41.128404 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e1a91-8974-4b65-941e-b013ce8b94d2 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:41.128548 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e1a91-8974-4b65-941e-b013ce8b94d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:41.147988 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-2b5e1a91-8974-4b65-941e-b013ce8b94d2 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:19:41.149182 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-2b5e1a91-8974-4b65-941e-b013ce8b94d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:19:41.157509 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 537/1097] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:19:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:19:41.201133 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5205012-5bea-4d8e-be4a-96414d22309d None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:19:41.215571 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5205012-5bea-4d8e-be4a-96414d22309d None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:19:41.221352 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d8d43-c860-4b31-b80a-b56128faeb63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:19:41.221959 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d8d43-c860-4b31-b80a-b56128faeb63 service nova] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:41.222240 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d8d43-c860-4b31-b80a-b56128faeb63 service nova] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:41.222516 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d8d43-c860-4b31-b80a-b56128faeb63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:41.230655 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d8d43-c860-4b31-b80a-b56128faeb63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:19:41.232271 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d8d43-c860-4b31-b80a-b56128faeb63 service nova] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:19:41.241475 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 561/1098] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:19:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:19:43.629122 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e0711-3b34-46fd-b75e-8513d080bc16 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:43.629645 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e0711-3b34-46fd-b75e-8513d080bc16 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:43.629645 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e0711-3b34-46fd-b75e-8513d080bc16 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:43.631256 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 538/1099] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:19:43.636482 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab824b47-038c-4d6a-9ed4-de7f02327f9e None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:43.636900 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab824b47-038c-4d6a-9ed4-de7f02327f9e None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:43.637032 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab824b47-038c-4d6a-9ed4-de7f02327f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:43.656679 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-ab824b47-038c-4d6a-9ed4-de7f02327f9e None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:19:43.657861 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-ab824b47-038c-4d6a-9ed4-de7f02327f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:19:43.665634 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 562/1100] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:19:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:19:43.703473 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e0711-3b34-46fd-b75e-8513d080bc16 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:19:43.714214 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e0711-3b34-46fd-b75e-8513d080bc16 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:19:43.717742 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174489fd-2f3c-4f1d-9167-eb80f4b90186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:19:43.718347 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174489fd-2f3c-4f1d-9167-eb80f4b90186 service neutron] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:43.718629 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174489fd-2f3c-4f1d-9167-eb80f4b90186 service neutron] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:43.718902 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174489fd-2f3c-4f1d-9167-eb80f4b90186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:43.727851 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174489fd-2f3c-4f1d-9167-eb80f4b90186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:19:43.729270 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174489fd-2f3c-4f1d-9167-eb80f4b90186 service neutron] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:19:43.738484 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 539/1101] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:19:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:19:46.018076 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298f502-bf0d-4f42-8505-bd68f6dd9194 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:46.018637 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298f502-bf0d-4f42-8505-bd68f6dd9194 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:46.018637 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298f502-bf0d-4f42-8505-bd68f6dd9194 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:46.019986 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 563/1102] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:19:46.025185 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a51a77-a532-4711-b520-795fdb33220e None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:46.025630 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a51a77-a532-4711-b520-795fdb33220e None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:46.025737 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a51a77-a532-4711-b520-795fdb33220e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:46.044714 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-67a51a77-a532-4711-b520-795fdb33220e None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:19:46.046547 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-67a51a77-a532-4711-b520-795fdb33220e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:19:46.054415 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 540/1103] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:19:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:19:46.092120 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298f502-bf0d-4f42-8505-bd68f6dd9194 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:19:46.103284 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298f502-bf0d-4f42-8505-bd68f6dd9194 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:19:46.106645 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97428fd6-f8c5-4385-bbd6-f80aa71fe9a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:19:46.107264 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97428fd6-f8c5-4385-bbd6-f80aa71fe9a7 service neutron] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:46.107537 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97428fd6-f8c5-4385-bbd6-f80aa71fe9a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:46.107803 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97428fd6-f8c5-4385-bbd6-f80aa71fe9a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:46.116982 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97428fd6-f8c5-4385-bbd6-f80aa71fe9a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:19:46.118385 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97428fd6-f8c5-4385-bbd6-f80aa71fe9a7 service neutron] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:19:46.127776 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 564/1104] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:19:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:19:48.535919 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f2a5a-7c2d-408d-98b5-a6cb17822f45 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:48.536503 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f2a5a-7c2d-408d-98b5-a6cb17822f45 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:48.536503 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f2a5a-7c2d-408d-98b5-a6cb17822f45 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:48.537828 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 541/1105] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:19:48.543100 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07eaa70-5857-41df-a46e-0e7d9a4779ab None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:48.543496 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07eaa70-5857-41df-a46e-0e7d9a4779ab None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:48.543665 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07eaa70-5857-41df-a46e-0e7d9a4779ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:48.563317 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-a07eaa70-5857-41df-a46e-0e7d9a4779ab None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:19:48.564497 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-a07eaa70-5857-41df-a46e-0e7d9a4779ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:19:48.572209 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 565/1106] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:19:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:19:48.613426 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f2a5a-7c2d-408d-98b5-a6cb17822f45 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:19:48.624610 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f2a5a-7c2d-408d-98b5-a6cb17822f45 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:19:48.628109 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adae4f8-d8fb-4ec6-a526-d8c9598cbb9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:19:48.628733 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adae4f8-d8fb-4ec6-a526-d8c9598cbb9d service neutron] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:48.629015 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adae4f8-d8fb-4ec6-a526-d8c9598cbb9d service neutron] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:48.629287 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adae4f8-d8fb-4ec6-a526-d8c9598cbb9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:48.638270 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adae4f8-d8fb-4ec6-a526-d8c9598cbb9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:19:48.639736 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adae4f8-d8fb-4ec6-a526-d8c9598cbb9d service neutron] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:19:48.648995 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 542/1107] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:19:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 20:19:51.122713 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2412cf7-7733-41c3-bd05-5eb152d57227 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:51.123318 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2412cf7-7733-41c3-bd05-5eb152d57227 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:51.123318 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2412cf7-7733-41c3-bd05-5eb152d57227 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:51.125236 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 566/1108] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 27 20:19:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:19:51.130740 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7cfcf-5b01-4262-ae1e-ee9cd0d7c37f None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:51.131155 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7cfcf-5b01-4262-ae1e-ee9cd0d7c37f None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:51.131406 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7cfcf-5b01-4262-ae1e-ee9cd0d7c37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:51.150120 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-74d7cfcf-5b01-4262-ae1e-ee9cd0d7c37f None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:19:51.151349 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-74d7cfcf-5b01-4262-ae1e-ee9cd0d7c37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:19:51.159619 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 543/1109] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 27 20:19:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 20:19:51.199738 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2412cf7-7733-41c3-bd05-5eb152d57227 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:19:51.210374 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2412cf7-7733-41c3-bd05-5eb152d57227 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:19:51.213903 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208591df-987c-418f-b640-f2212fe59f87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:19:51.214506 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208591df-987c-418f-b640-f2212fe59f87 service neutron] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:19:51.214785 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208591df-987c-418f-b640-f2212fe59f87 service neutron] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:19:51.215059 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208591df-987c-418f-b640-f2212fe59f87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:19:51.224457 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208591df-987c-418f-b640-f2212fe59f87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:19:51.225885 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208591df-987c-418f-b640-f2212fe59f87 service neutron] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:19:51.235812 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 567/1110] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:19:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:20:01.145431 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=33 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:20:01.231013 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=33 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:21:20.014575 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3cc52-643d-480b-8cf9-c0f7f0236bed None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:21:20.015219 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3cc52-643d-480b-8cf9-c0f7f0236bed None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:21:20.015219 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3cc52-643d-480b-8cf9-c0f7f0236bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:21:20.034535 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-4ea3cc52-643d-480b-8cf9-c0f7f0236bed None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:21:20.035765 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-4ea3cc52-643d-480b-8cf9-c0f7f0236bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:21:20.043535 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 544/1111] 10.222.0.83 () {58 vars in 958 bytes} [Wed Jul 27 20:21:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:21:20.051432 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8230d-064a-4804-832e-63119d532a34 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:21:20.051955 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8230d-064a-4804-832e-63119d532a34 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:21:20.052054 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8230d-064a-4804-832e-63119d532a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:21:20.070473 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-9bb8230d-064a-4804-832e-63119d532a34 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:21:20.071668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-9bb8230d-064a-4804-832e-63119d532a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:21:20.079779 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 568/1112] 10.222.0.83 () {58 vars in 958 bytes} [Wed Jul 27 20:21:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:21:20.083996 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3cc52-643d-480b-8cf9-c0f7f0236bed None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:21:20.093926 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3cc52-643d-480b-8cf9-c0f7f0236bed None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:21:20.098386 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbea496-ff3e-45ed-80d3-ac4f61d081cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:21:20.098985 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbea496-ff3e-45ed-80d3-ac4f61d081cd admin admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:21:20.099295 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbea496-ff3e-45ed-80d3-ac4f61d081cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:21:20.099573 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbea496-ff3e-45ed-80d3-ac4f61d081cd admin admin] PATH_INFO: `/v3/domains` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:21:20.100260 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbea496-ff3e-45ed-80d3-ac4f61d081cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:21:20.100565 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbea496-ff3e-45ed-80d3-ac4f61d081cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:21:20.101571 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: WARNING py.warnings [None req-0dbea496-ff3e-45ed-80d3-ac4f61d081cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:21:20.101571 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: warnings.warn(msg) Jul 27 20:21:20.101571 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: Jul 27 20:21:20.102454 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbea496-ff3e-45ed-80d3-ac4f61d081cd admin admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:21:20.113724 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 545/1113] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Jul 27 20:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:21:20.121510 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8230d-064a-4804-832e-63119d532a34 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:21:20.130614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8230d-064a-4804-832e-63119d532a34 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:21:20.135385 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd773d-3d71-441a-9660-a52571d0e106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:21:20.136466 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd773d-3d71-441a-9660-a52571d0e106 admin admin] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:21:20.136739 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd773d-3d71-441a-9660-a52571d0e106 admin admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:21:20.137005 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd773d-3d71-441a-9660-a52571d0e106 admin admin] PATH_INFO: `/v3/projects` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:21:20.137648 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd773d-3d71-441a-9660-a52571d0e106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:21:20.139416 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: WARNING py.warnings [None req-f8bd773d-3d71-441a-9660-a52571d0e106 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:21:20.139416 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: warnings.warn(msg) Jul 27 20:21:20.139416 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: Jul 27 20:21:20.140658 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd773d-3d71-441a-9660-a52571d0e106 admin admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:21:20.167532 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 569/1114] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Jul 27 20:21:20 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:21:20.171537 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbea496-ff3e-45ed-80d3-ac4f61d081cd admin admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:21:20.181332 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbea496-ff3e-45ed-80d3-ac4f61d081cd admin admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:21:20.236466 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af69edc-f2b2-4454-9708-f6cc2cfdfb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:21:20.237073 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af69edc-f2b2-4454-9708-f6cc2cfdfb20 admin admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:21:20.237370 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af69edc-f2b2-4454-9708-f6cc2cfdfb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:21:20.237717 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af69edc-f2b2-4454-9708-f6cc2cfdfb20 admin admin] PATH_INFO: `/v3/users` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:21:20.238556 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af69edc-f2b2-4454-9708-f6cc2cfdfb20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:21:20.239583 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: WARNING py.warnings [None req-8af69edc-f2b2-4454-9708-f6cc2cfdfb20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:21:20.239583 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: warnings.warn(msg) Jul 27 20:21:20.239583 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: Jul 27 20:21:20.240789 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af69edc-f2b2-4454-9708-f6cc2cfdfb20 admin admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:21:20.261790 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 546/1115] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Jul 27 20:21:20 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:21:20.265995 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd773d-3d71-441a-9660-a52571d0e106 admin admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:21:20.275876 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd773d-3d71-441a-9660-a52571d0e106 admin admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:21:20.280968 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e223cb2-762a-44e7-be27-e75267c002ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:21:20.281564 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e223cb2-762a-44e7-be27-e75267c002ff admin admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:21:20.281839 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e223cb2-762a-44e7-be27-e75267c002ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:21:20.282107 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e223cb2-762a-44e7-be27-e75267c002ff admin admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:21:20.282792 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e223cb2-762a-44e7-be27-e75267c002ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:21:20.283807 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: WARNING py.warnings [None req-7e223cb2-762a-44e7-be27-e75267c002ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:21:20.283807 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: warnings.warn(msg) Jul 27 20:21:20.283807 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: Jul 27 20:21:20.284692 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e223cb2-762a-44e7-be27-e75267c002ff admin admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:21:20.300243 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 570/1116] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Jul 27 20:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 20:21:20.304498 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af69edc-f2b2-4454-9708-f6cc2cfdfb20 admin admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:21:20.316491 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af69edc-f2b2-4454-9708-f6cc2cfdfb20 admin admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:21:20.325283 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26d46b-6faa-4587-a844-b8c3371a5ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:21:20.325906 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26d46b-6faa-4587-a844-b8c3371a5ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:21:20.326187 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26d46b-6faa-4587-a844-b8c3371a5ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:21:20.326459 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26d46b-6faa-4587-a844-b8c3371a5ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:21:20.327182 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26d46b-6faa-4587-a844-b8c3371a5ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:21:20.328190 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: WARNING py.warnings [None req-ff26d46b-6faa-4587-a844-b8c3371a5ee2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:21:20.328190 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: warnings.warn(msg) Jul 27 20:21:20.328190 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: Jul 27 20:21:20.329073 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26d46b-6faa-4587-a844-b8c3371a5ee2 admin admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:21:20.343059 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 547/1117] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Jul 27 20:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 20:21:20.347245 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e223cb2-762a-44e7-be27-e75267c002ff admin admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:21:20.357592 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e223cb2-762a-44e7-be27-e75267c002ff admin admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:21:20.362064 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8be34f-9db2-4f9c-b65c-21fa15141b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:21:20.362711 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8be34f-9db2-4f9c-b65c-21fa15141b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:21:20.362985 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8be34f-9db2-4f9c-b65c-21fa15141b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:21:20.363287 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8be34f-9db2-4f9c-b65c-21fa15141b9d admin admin] PATH_INFO: `/v3/projects/a98eb3e62e134908bbb14b1bd771e52a/users/fac0482402ac4bd0ace10cbb140dffc9/roles/13a38ce5696549bf95272ffae43798c8` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:21:20.378818 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8be34f-9db2-4f9c-b65c-21fa15141b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a98eb3e62e134908bbb14b1bd771e52a, user_id=fac0482402ac4bd0ace10cbb140dffc9, role_id=13a38ce5696549bf95272ffae43798c8)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:21:20.380137 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: WARNING py.warnings [None req-ee8be34f-9db2-4f9c-b65c-21fa15141b9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:21:20.380137 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: warnings.warn(msg) Jul 27 20:21:20.380137 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: Jul 27 20:21:20.382054 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8be34f-9db2-4f9c-b65c-21fa15141b9d admin admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:21:20.398740 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 571/1118] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Jul 27 20:21:20 2022] PUT /identity/v3/projects/a98eb3e62e134908bbb14b1bd771e52a/users/fac0482402ac4bd0ace10cbb140dffc9/roles/13a38ce5696549bf95272ffae43798c8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:21:20.414045 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65db8e6-ec97-4704-9cb6-2421f7227a8b None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:21:20.414347 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65db8e6-ec97-4704-9cb6-2421f7227a8b None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:21:20.414618 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65db8e6-ec97-4704-9cb6-2421f7227a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:21:20.445289 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-e65db8e6-ec97-4704-9cb6-2421f7227a8b None None] MFA Rules not processed for user `fac0482402ac4bd0ace10cbb140dffc9`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:21:20.446491 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-e65db8e6-ec97-4704-9cb6-2421f7227a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:21:20.508666 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 548/1119] 10.222.0.83 () {58 vars in 958 bytes} [Wed Jul 27 20:21:20 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:21:20.526208 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6c7cf-97c3-48f7-a506-7244eaf300e3 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:21:20.526487 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6c7cf-97c3-48f7-a506-7244eaf300e3 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:21:20.526757 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6c7cf-97c3-48f7-a506-7244eaf300e3 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:21:20.528154 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 572/1120] 10.222.0.83 () {54 vars in 964 bytes} [Wed Jul 27 20:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:21:20.533243 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97901a-d2ed-44a6-b56c-a34ed14d8aa5 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:21:20.533650 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97901a-d2ed-44a6-b56c-a34ed14d8aa5 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:21:20.533928 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97901a-d2ed-44a6-b56c-a34ed14d8aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:21:20.558831 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-2f97901a-d2ed-44a6-b56c-a34ed14d8aa5 None None] MFA Rules not processed for user `4bf3f75970b342609acb2542913b068d`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:21:20.560305 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-2f97901a-d2ed-44a6-b56c-a34ed14d8aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:21:20.617972 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:21:20.629325 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 549/1121] 10.222.0.83 () {58 vars in 1061 bytes} [Wed Jul 27 20:21:20 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:21:20.637723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6c7cf-97c3-48f7-a506-7244eaf300e3 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:21:20.648342 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6c7cf-97c3-48f7-a506-7244eaf300e3 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:21:20.651780 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb9655-e77d-46b4-aa7d-28067503e13f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bf3f75970b342609acb2542913b068d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:21:20.652367 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb9655-e77d-46b4-aa7d-28067503e13f service cinder] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:21:20.652643 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb9655-e77d-46b4-aa7d-28067503e13f service cinder] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:21:20.652915 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb9655-e77d-46b4-aa7d-28067503e13f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:21:20.660886 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb9655-e77d-46b4-aa7d-28067503e13f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:21:20.662299 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb9655-e77d-46b4-aa7d-28067503e13f service cinder] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:21:20.670755 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 573/1122] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:21:20 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:21:20.709084 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd47d3-68cc-44df-a481-76c0765d0944 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:21:20.709375 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd47d3-68cc-44df-a481-76c0765d0944 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:21:20.709647 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd47d3-68cc-44df-a481-76c0765d0944 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:21:20.710942 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 550/1123] 10.222.0.83 () {52 vars in 830 bytes} [Wed Jul 27 20:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:21:20.715176 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb9655-e77d-46b4-aa7d-28067503e13f service cinder] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:21:20.775614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb9655-e77d-46b4-aa7d-28067503e13f service cinder] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:21:20.780078 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285d13a-83f8-40c1-ac50-6215f3e0114d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:21:20.780707 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285d13a-83f8-40c1-ac50-6215f3e0114d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:21:20.780984 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285d13a-83f8-40c1-ac50-6215f3e0114d admin admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:21:20.781253 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285d13a-83f8-40c1-ac50-6215f3e0114d admin admin] PATH_INFO: `/v3/users/fac0482402ac4bd0ace10cbb140dffc9` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:21:20.782411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285d13a-83f8-40c1-ac50-6215f3e0114d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fac0482402ac4bd0ace10cbb140dffc9)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:21:20.783457 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: WARNING py.warnings [None req-4285d13a-83f8-40c1-ac50-6215f3e0114d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:21:20.783457 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: warnings.warn(msg) Jul 27 20:21:20.783457 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: Jul 27 20:21:20.784654 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285d13a-83f8-40c1-ac50-6215f3e0114d admin admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:21:20.850091 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-4285d13a-83f8-40c1-ac50-6215f3e0114d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fac0482402ac4bd0ace10cbb140dffc9'} {{(pid=87126) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:21:20.859041 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-4285d13a-83f8-40c1-ac50-6215f3e0114d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fac0482402ac4bd0ace10cbb140dffc9'} {{(pid=87126) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:21:20.877782 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-4285d13a-83f8-40c1-ac50-6215f3e0114d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fac0482402ac4bd0ace10cbb140dffc9'} {{(pid=87126) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:21:20.878527 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-4285d13a-83f8-40c1-ac50-6215f3e0114d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fac0482402ac4bd0ace10cbb140dffc9'} {{(pid=87126) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:21:20.890703 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-4285d13a-83f8-40c1-ac50-6215f3e0114d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fac0482402ac4bd0ace10cbb140dffc9'} {{(pid=87126) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:21:20.898291 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 574/1124] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Jul 27 20:21:20 2022] DELETE /identity/v3/users/fac0482402ac4bd0ace10cbb140dffc9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:21:20.903802 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f6191-29a1-42f0-967b-e32165a5345c None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:21:20.904130 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f6191-29a1-42f0-967b-e32165a5345c None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:21:20.904439 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f6191-29a1-42f0-967b-e32165a5345c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:21:20.923879 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-650f6191-29a1-42f0-967b-e32165a5345c None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:21:20.925082 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-650f6191-29a1-42f0-967b-e32165a5345c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:21:20.986221 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 551/1125] 10.222.0.83 () {58 vars in 958 bytes} [Wed Jul 27 20:21:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:21:20.996925 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285d13a-83f8-40c1-ac50-6215f3e0114d admin admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:21:20.998339 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-4285d13a-83f8-40c1-ac50-6215f3e0114d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:21:21.003771 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:21:21.055355 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285d13a-83f8-40c1-ac50-6215f3e0114d admin admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:21:21.059592 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc14010-122a-4e79-965d-66864ba96a24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:21:21.060242 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc14010-122a-4e79-965d-66864ba96a24 service neutron] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:21:21.060519 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc14010-122a-4e79-965d-66864ba96a24 service neutron] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:21:21.060844 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc14010-122a-4e79-965d-66864ba96a24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:21:21.069713 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc14010-122a-4e79-965d-66864ba96a24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:21:21.071183 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc14010-122a-4e79-965d-66864ba96a24 service neutron] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:21:21.080314 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 575/1126] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:21:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 20:21:21.430953 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f6191-29a1-42f0-967b-e32165a5345c None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:21:21.432447 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-650f6191-29a1-42f0-967b-e32165a5345c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:21:21.444649 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f6191-29a1-42f0-967b-e32165a5345c None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:21:21.453328 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca763b3-7831-4214-bef1-c2a82f21d419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:21:21.453328 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca763b3-7831-4214-bef1-c2a82f21d419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:21:21.453328 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca763b3-7831-4214-bef1-c2a82f21d419 admin admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:21:21.453328 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca763b3-7831-4214-bef1-c2a82f21d419 admin admin] PATH_INFO: `/v3/projects/a98eb3e62e134908bbb14b1bd771e52a` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:21:21.454165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca763b3-7831-4214-bef1-c2a82f21d419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a98eb3e62e134908bbb14b1bd771e52a)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:21:21.454165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: WARNING py.warnings [None req-8ca763b3-7831-4214-bef1-c2a82f21d419 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:21:21.454165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: warnings.warn(msg) Jul 27 20:21:21.454165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: Jul 27 20:21:21.454165 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca763b3-7831-4214-bef1-c2a82f21d419 admin admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:21:21.519018 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [None req-8ca763b3-7831-4214-bef1-c2a82f21d419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a98eb3e62e134908bbb14b1bd771e52a', 'request_id': 'req-8ca763b3-7831-4214-bef1-c2a82f21d419'} {{(pid=87127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:21:21.541292 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [None req-8ca763b3-7831-4214-bef1-c2a82f21d419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a98eb3e62e134908bbb14b1bd771e52a', 'request_id': 'req-8ca763b3-7831-4214-bef1-c2a82f21d419'} {{(pid=87127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:21:21.541292 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [None req-8ca763b3-7831-4214-bef1-c2a82f21d419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a98eb3e62e134908bbb14b1bd771e52a', 'request_id': 'req-8ca763b3-7831-4214-bef1-c2a82f21d419'} {{(pid=87127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:21:21.556560 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [None req-8ca763b3-7831-4214-bef1-c2a82f21d419 admin admin] The token cache is being invalidate because project a98eb3e62e134908bbb14b1bd771e52a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 20:21:21.556851 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [None req-8ca763b3-7831-4214-bef1-c2a82f21d419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:21:21.557495 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [None req-8ca763b3-7831-4214-bef1-c2a82f21d419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:21:21.559134 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 552/1127] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Jul 27 20:21:21 2022] DELETE /identity/v3/projects/a98eb3e62e134908bbb14b1bd771e52a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 20:21:31.076411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=25 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:21:31.553514 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:22:46.913115 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1be802-b579-4fcc-ae98-ba4efa6d89ee None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:22:46.913688 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1be802-b579-4fcc-ae98-ba4efa6d89ee None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:22:46.913688 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1be802-b579-4fcc-ae98-ba4efa6d89ee None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:22:46.915028 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 576/1128] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 20:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 20:22:46.920077 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78572ca-4e4b-4da6-8581-be6b83ad6f98 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:22:46.920487 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78572ca-4e4b-4da6-8581-be6b83ad6f98 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:22:46.920636 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78572ca-4e4b-4da6-8581-be6b83ad6f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:22:46.993895 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-e78572ca-4e4b-4da6-8581-be6b83ad6f98 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:22:46.995130 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-e78572ca-4e4b-4da6-8581-be6b83ad6f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:22:47.088391 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 553/1129] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 20:22:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:22:47.262932 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1be802-b579-4fcc-ae98-ba4efa6d89ee None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:22:47.264651 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-6d1be802-b579-4fcc-ae98-ba4efa6d89ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:22:47.352102 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1be802-b579-4fcc-ae98-ba4efa6d89ee None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:22:47.357126 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d34e1-ddca-45fc-9638-f2eb1bb8e782 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:22:47.357743 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d34e1-ddca-45fc-9638-f2eb1bb8e782 service nova] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:22:47.358027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d34e1-ddca-45fc-9638-f2eb1bb8e782 service nova] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:22:47.358302 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d34e1-ddca-45fc-9638-f2eb1bb8e782 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:22:47.366247 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d34e1-ddca-45fc-9638-f2eb1bb8e782 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:22:47.368494 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d34e1-ddca-45fc-9638-f2eb1bb8e782 service nova] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:22:47.377710 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 577/1130] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:22:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:22:48.203191 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc859cf0-2c08-4663-8beb-e718599429c7 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:22:48.203700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc859cf0-2c08-4663-8beb-e718599429c7 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:22:48.203700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc859cf0-2c08-4663-8beb-e718599429c7 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:22:48.205023 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 554/1131] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 20:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:22:48.209804 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c89c2-7fb5-4c4a-a8b6-1276014c8868 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:22:48.210217 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c89c2-7fb5-4c4a-a8b6-1276014c8868 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:22:48.210348 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c89c2-7fb5-4c4a-a8b6-1276014c8868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:22:48.229608 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-040c89c2-7fb5-4c4a-a8b6-1276014c8868 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:22:48.230797 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-040c89c2-7fb5-4c4a-a8b6-1276014c8868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:22:48.238576 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 578/1132] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 20:22:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:22:48.398729 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc859cf0-2c08-4663-8beb-e718599429c7 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:22:48.412016 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc859cf0-2c08-4663-8beb-e718599429c7 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:22:48.416929 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b86101-9a09-43c6-8793-77347b6c7b91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:22:48.417529 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b86101-9a09-43c6-8793-77347b6c7b91 service nova] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:22:48.417838 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b86101-9a09-43c6-8793-77347b6c7b91 service nova] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:22:48.418112 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b86101-9a09-43c6-8793-77347b6c7b91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:22:48.426606 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b86101-9a09-43c6-8793-77347b6c7b91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:22:48.428221 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b86101-9a09-43c6-8793-77347b6c7b91 service nova] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:22:48.437974 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 555/1133] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:22:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:22:53.294488 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cc3f7-a3ed-473b-ab18-f1a982c29f85 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:22:53.295107 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cc3f7-a3ed-473b-ab18-f1a982c29f85 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:22:53.295107 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cc3f7-a3ed-473b-ab18-f1a982c29f85 None None] PATH_INFO: `/v3` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:22:53.296343 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 579/1134] 10.222.0.84 () {54 vars in 925 bytes} [Wed Jul 27 20:22:53 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 20:22:53.302196 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2524a5-258d-4110-94f9-ef562efb9f64 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:22:53.302607 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2524a5-258d-4110-94f9-ef562efb9f64 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:22:53.302773 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2524a5-258d-4110-94f9-ef562efb9f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:22:53.332120 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-6e2524a5-258d-4110-94f9-ef562efb9f64 None None] MFA Rules not processed for user `733839729aa249e0823f24a8e8fb3ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:22:53.333317 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-6e2524a5-258d-4110-94f9-ef562efb9f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:22:53.385194 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:22:53.395002 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 556/1135] 10.222.0.84 () {58 vars in 1015 bytes} [Wed Jul 27 20:22:53 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 20:22:58.224825 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=42 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:22:59.681030 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbebe51-7d65-4cc6-8aeb-c89b11e5a44d None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:22:59.681668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbebe51-7d65-4cc6-8aeb-c89b11e5a44d None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:22:59.681668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbebe51-7d65-4cc6-8aeb-c89b11e5a44d None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:22:59.682839 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 580/1136] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 20:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:22:59.687680 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e977fd9-7926-4a22-bd92-69e028ef28d7 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:22:59.688135 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e977fd9-7926-4a22-bd92-69e028ef28d7 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:22:59.688244 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e977fd9-7926-4a22-bd92-69e028ef28d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:22:59.707564 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-3e977fd9-7926-4a22-bd92-69e028ef28d7 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:22:59.708736 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-3e977fd9-7926-4a22-bd92-69e028ef28d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:22:59.717046 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 557/1137] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 20:22:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:22:59.876931 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbebe51-7d65-4cc6-8aeb-c89b11e5a44d None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:22:59.890998 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbebe51-7d65-4cc6-8aeb-c89b11e5a44d None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:22:59.895847 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01103700-3386-4f38-b79b-6d973637e48d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:22:59.896439 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01103700-3386-4f38-b79b-6d973637e48d service nova] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:22:59.896715 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01103700-3386-4f38-b79b-6d973637e48d service nova] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:22:59.896984 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01103700-3386-4f38-b79b-6d973637e48d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:22:59.905419 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01103700-3386-4f38-b79b-6d973637e48d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:22:59.906983 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01103700-3386-4f38-b79b-6d973637e48d service nova] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:22:59.916220 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 581/1138] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:22:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:23:00.739806 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1879794-3223-41ab-8c52-a1b311fd4364 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:23:00.740361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1879794-3223-41ab-8c52-a1b311fd4364 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:23:00.740361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1879794-3223-41ab-8c52-a1b311fd4364 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:23:00.741697 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 558/1139] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 20:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:23:00.747307 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa3575-8454-4f37-ac1c-8d93a086f2eb None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:23:00.747738 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa3575-8454-4f37-ac1c-8d93a086f2eb None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:23:00.747881 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa3575-8454-4f37-ac1c-8d93a086f2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:23:00.767014 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-2cfa3575-8454-4f37-ac1c-8d93a086f2eb None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:23:00.768272 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-2cfa3575-8454-4f37-ac1c-8d93a086f2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:23:00.778747 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 582/1140] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 20:23:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:23:00.939702 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1879794-3223-41ab-8c52-a1b311fd4364 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:23:00.953250 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1879794-3223-41ab-8c52-a1b311fd4364 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:23:00.958159 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0b1c3-28eb-4d3e-a08b-c69d70ba8c91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:23:00.958766 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0b1c3-28eb-4d3e-a08b-c69d70ba8c91 service nova] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:23:00.959051 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0b1c3-28eb-4d3e-a08b-c69d70ba8c91 service nova] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:23:00.959355 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0b1c3-28eb-4d3e-a08b-c69d70ba8c91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:23:00.967994 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0b1c3-28eb-4d3e-a08b-c69d70ba8c91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:23:00.969700 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0b1c3-28eb-4d3e-a08b-c69d70ba8c91 service nova] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:23:00.979764 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 559/1141] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:23:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:23:02.341201 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe87699-04c9-4f31-8c01-deffdb436a3e None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:23:02.341651 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe87699-04c9-4f31-8c01-deffdb436a3e None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:23:02.341753 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe87699-04c9-4f31-8c01-deffdb436a3e None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:23:02.343141 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 583/1142] 10.222.0.83 () {54 vars in 961 bytes} [Wed Jul 27 20:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:23:02.348454 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44678dfe-a771-4ebc-980e-00016bf4ce0e None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:23:02.348848 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44678dfe-a771-4ebc-980e-00016bf4ce0e None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:23:02.349003 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44678dfe-a771-4ebc-980e-00016bf4ce0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:23:02.368735 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-44678dfe-a771-4ebc-980e-00016bf4ce0e None None] MFA Rules not processed for user `733839729aa249e0823f24a8e8fb3ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:23:02.369926 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-44678dfe-a771-4ebc-980e-00016bf4ce0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:23:02.378596 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 560/1143] 10.222.0.83 () {58 vars in 1058 bytes} [Wed Jul 27 20:23:02 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:23:02.385949 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe87699-04c9-4f31-8c01-deffdb436a3e None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:23:02.399579 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe87699-04c9-4f31-8c01-deffdb436a3e None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:23:02.404454 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c843dbe-6778-4737-8419-999e5fa2686a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733839729aa249e0823f24a8e8fb3ffe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:23:02.405048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c843dbe-6778-4737-8419-999e5fa2686a service placement] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:23:02.405327 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c843dbe-6778-4737-8419-999e5fa2686a service placement] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:23:02.405602 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c843dbe-6778-4737-8419-999e5fa2686a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:23:02.413729 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c843dbe-6778-4737-8419-999e5fa2686a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:23:02.415982 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c843dbe-6778-4737-8419-999e5fa2686a service placement] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:23:02.425400 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 584/1144] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:23:02 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:23:12.209197 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566aba3a-f3d2-4a50-b02b-f4fe4986cf19 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:23:12.209766 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566aba3a-f3d2-4a50-b02b-f4fe4986cf19 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:23:12.209766 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566aba3a-f3d2-4a50-b02b-f4fe4986cf19 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:23:12.211130 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 561/1145] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 20:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:23:12.216609 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704ddd1-027e-4f93-86d7-1ed301f7746d None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:23:12.217030 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704ddd1-027e-4f93-86d7-1ed301f7746d None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:23:12.217166 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704ddd1-027e-4f93-86d7-1ed301f7746d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:23:12.239829 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-6704ddd1-027e-4f93-86d7-1ed301f7746d None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:23:12.241027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-6704ddd1-027e-4f93-86d7-1ed301f7746d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:23:12.248800 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 585/1146] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 20:23:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:23:12.364153 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=12 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:23:12.408625 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566aba3a-f3d2-4a50-b02b-f4fe4986cf19 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:23:12.422953 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566aba3a-f3d2-4a50-b02b-f4fe4986cf19 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:23:12.427879 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb1743-2099-4bea-a5e3-316849b6e83c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:23:12.428481 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb1743-2099-4bea-a5e3-316849b6e83c service nova] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:23:12.428764 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb1743-2099-4bea-a5e3-316849b6e83c service nova] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:23:12.429040 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb1743-2099-4bea-a5e3-316849b6e83c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:23:12.437208 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb1743-2099-4bea-a5e3-316849b6e83c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:23:12.438794 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb1743-2099-4bea-a5e3-316849b6e83c service nova] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:23:12.448540 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 562/1147] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:23:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:23:13.268495 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aade31d-dfc7-4910-abf0-7d9f57feefdd None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:23:13.269048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aade31d-dfc7-4910-abf0-7d9f57feefdd None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:23:13.269048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aade31d-dfc7-4910-abf0-7d9f57feefdd None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:23:13.270363 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 586/1148] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 20:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 20:23:13.275444 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a623c8-a2b3-4987-adac-0f51353487eb None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:23:13.276148 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a623c8-a2b3-4987-adac-0f51353487eb None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:23:13.276148 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a623c8-a2b3-4987-adac-0f51353487eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:23:13.296199 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-68a623c8-a2b3-4987-adac-0f51353487eb None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:23:13.297395 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-68a623c8-a2b3-4987-adac-0f51353487eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:23:13.305141 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 563/1149] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 20:23:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:23:13.460738 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aade31d-dfc7-4910-abf0-7d9f57feefdd None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:23:13.474688 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aade31d-dfc7-4910-abf0-7d9f57feefdd None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:23:13.480110 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da4279-6d6e-4f8c-b77f-9e42d33b90cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:23:13.480716 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da4279-6d6e-4f8c-b77f-9e42d33b90cb service nova] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:23:13.480996 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da4279-6d6e-4f8c-b77f-9e42d33b90cb service nova] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:23:13.481270 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da4279-6d6e-4f8c-b77f-9e42d33b90cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:23:13.489346 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da4279-6d6e-4f8c-b77f-9e42d33b90cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:23:13.490935 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da4279-6d6e-4f8c-b77f-9e42d33b90cb service nova] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:23:13.500776 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 587/1150] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:23:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:23:17.493570 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e0953-7515-43c7-9409-df36280c6f5b None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:23:17.494096 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e0953-7515-43c7-9409-df36280c6f5b None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:23:17.494096 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e0953-7515-43c7-9409-df36280c6f5b None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:23:17.495496 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 564/1151] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 20:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:23:17.500612 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e6bc0-4a67-4ee9-a3f4-ef1001b81ea1 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:23:17.501026 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e6bc0-4a67-4ee9-a3f4-ef1001b81ea1 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:23:17.501162 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e6bc0-4a67-4ee9-a3f4-ef1001b81ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:23:17.520194 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-2c6e6bc0-4a67-4ee9-a3f4-ef1001b81ea1 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:23:17.521387 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-2c6e6bc0-4a67-4ee9-a3f4-ef1001b81ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:23:17.529561 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 588/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 20:23:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:23:17.567939 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e0953-7515-43c7-9409-df36280c6f5b None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:23:17.569540 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-048e0953-7515-43c7-9409-df36280c6f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:23:17.625526 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e0953-7515-43c7-9409-df36280c6f5b None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:23:17.629266 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115ea54-494c-424f-9dca-05a838615a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:23:17.629923 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115ea54-494c-424f-9dca-05a838615a66 service neutron] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:23:17.630161 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115ea54-494c-424f-9dca-05a838615a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:23:17.630436 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115ea54-494c-424f-9dca-05a838615a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:23:17.639156 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115ea54-494c-424f-9dca-05a838615a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:23:17.640580 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115ea54-494c-424f-9dca-05a838615a66 service neutron] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:23:17.650931 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 565/1153] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:23:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:23:19.849078 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da9506-6a15-4064-9077-cc8066749898 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:23:19.849709 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da9506-6a15-4064-9077-cc8066749898 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:23:19.849709 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da9506-6a15-4064-9077-cc8066749898 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:23:19.850964 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 589/1154] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 20:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:23:19.856304 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc308ee6-6adb-42f7-ac57-c1082a266e94 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:23:19.856782 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc308ee6-6adb-42f7-ac57-c1082a266e94 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:23:19.856875 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc308ee6-6adb-42f7-ac57-c1082a266e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:23:19.876316 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-fc308ee6-6adb-42f7-ac57-c1082a266e94 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:23:19.877776 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-fc308ee6-6adb-42f7-ac57-c1082a266e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:23:19.886212 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 566/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 20:23:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:23:19.922696 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da9506-6a15-4064-9077-cc8066749898 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:23:19.934259 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da9506-6a15-4064-9077-cc8066749898 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:23:19.937828 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4828b-6016-439d-91c7-a21f307e3292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:23:19.938427 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4828b-6016-439d-91c7-a21f307e3292 service neutron] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:23:19.938704 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4828b-6016-439d-91c7-a21f307e3292 service neutron] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:23:19.938976 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4828b-6016-439d-91c7-a21f307e3292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:23:19.947827 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4828b-6016-439d-91c7-a21f307e3292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:23:19.949249 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4828b-6016-439d-91c7-a21f307e3292 service neutron] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:23:19.958387 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 590/1156] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:23:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:23:23.833216 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd685ba6-768e-4492-a5b6-539948df9c2a None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:23:23.833773 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd685ba6-768e-4492-a5b6-539948df9c2a None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:23:23.833773 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd685ba6-768e-4492-a5b6-539948df9c2a None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:23:23.835122 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 567/1157] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 20:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:23:23.840905 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365709a-0158-4f58-bbf2-1d552bd2669d None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:23:23.841315 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365709a-0158-4f58-bbf2-1d552bd2669d None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:23:23.841456 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365709a-0158-4f58-bbf2-1d552bd2669d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:23:23.860131 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-a365709a-0158-4f58-bbf2-1d552bd2669d None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:23:23.861321 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-a365709a-0158-4f58-bbf2-1d552bd2669d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:23:23.868991 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 591/1158] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 20:23:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:23:24.139118 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd685ba6-768e-4492-a5b6-539948df9c2a None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:23:24.140817 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-cd685ba6-768e-4492-a5b6-539948df9c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:23:24.205640 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd685ba6-768e-4492-a5b6-539948df9c2a None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:23:24.209191 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a467f-f722-461f-b081-c8399cb2fb53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bf3f75970b342609acb2542913b068d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:23:24.209814 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a467f-f722-461f-b081-c8399cb2fb53 service cinder] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:23:24.210099 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a467f-f722-461f-b081-c8399cb2fb53 service cinder] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:23:24.210381 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a467f-f722-461f-b081-c8399cb2fb53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:23:24.220190 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a467f-f722-461f-b081-c8399cb2fb53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:23:24.221610 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a467f-f722-461f-b081-c8399cb2fb53 service cinder] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:23:24.231027 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 568/1159] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:23:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:23:26.472764 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36575f2-14fb-4116-b88d-fcdd33f18424 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:23:26.473323 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36575f2-14fb-4116-b88d-fcdd33f18424 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:23:26.473323 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36575f2-14fb-4116-b88d-fcdd33f18424 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:23:26.474651 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 592/1160] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 20:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:23:26.480483 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbf8d7-d3e0-4500-b5a5-260b519448b2 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:23:26.480875 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbf8d7-d3e0-4500-b5a5-260b519448b2 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:23:26.481041 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbf8d7-d3e0-4500-b5a5-260b519448b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:23:26.505400 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-15fbf8d7-d3e0-4500-b5a5-260b519448b2 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:23:26.506625 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-15fbf8d7-d3e0-4500-b5a5-260b519448b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:23:26.514480 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 569/1161] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 20:23:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:23:26.791478 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36575f2-14fb-4116-b88d-fcdd33f18424 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:23:26.793167 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-a36575f2-14fb-4116-b88d-fcdd33f18424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:23:26.807906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36575f2-14fb-4116-b88d-fcdd33f18424 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:23:26.811653 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c67b5-3231-4865-a031-fa270d136379 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bf3f75970b342609acb2542913b068d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:23:26.812334 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c67b5-3231-4865-a031-fa270d136379 service cinder] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:23:26.812614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c67b5-3231-4865-a031-fa270d136379 service cinder] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:23:26.812887 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c67b5-3231-4865-a031-fa270d136379 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:23:26.822556 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c67b5-3231-4865-a031-fa270d136379 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:23:26.824048 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c67b5-3231-4865-a031-fa270d136379 service cinder] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:23:26.833346 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 593/1162] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:23:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:23:36.500047 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=67 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:23:36.829192 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=42 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:24:46.609172 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03549f0-a4f8-4856-83f2-c062aa9ba578 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:46.609846 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03549f0-a4f8-4856-83f2-c062aa9ba578 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:46.609846 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03549f0-a4f8-4856-83f2-c062aa9ba578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:46.628975 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-a03549f0-a4f8-4856-83f2-c062aa9ba578 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:24:46.630182 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29096db6-8f8b-4844-b669-a58c5b6f63fd None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:46.630760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29096db6-8f8b-4844-b669-a58c5b6f63fd None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:46.630760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29096db6-8f8b-4844-b669-a58c5b6f63fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:46.639406 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-a03549f0-a4f8-4856-83f2-c062aa9ba578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:24:46.648026 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 570/1163] 10.222.0.83 () {58 vars in 958 bytes} [Wed Jul 27 20:24:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:24:46.649944 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-29096db6-8f8b-4844-b669-a58c5b6f63fd None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:24:46.651154 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-29096db6-8f8b-4844-b669-a58c5b6f63fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:24:46.656222 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3752c-17c6-44fc-8917-51cf622735bf None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:46.656510 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3752c-17c6-44fc-8917-51cf622735bf None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:46.656786 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3752c-17c6-44fc-8917-51cf622735bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:46.658921 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 594/1164] 10.222.0.83 () {58 vars in 958 bytes} [Wed Jul 27 20:24:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 20:24:46.667398 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146de8a-faae-4cc0-a1eb-fbd529f13e93 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:46.667689 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146de8a-faae-4cc0-a1eb-fbd529f13e93 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:46.667972 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146de8a-faae-4cc0-a1eb-fbd529f13e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:46.677647 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-e9d3752c-17c6-44fc-8917-51cf622735bf None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:24:46.678846 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-e9d3752c-17c6-44fc-8917-51cf622735bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:24:46.686949 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 571/1165] 10.222.0.83 () {58 vars in 958 bytes} [Wed Jul 27 20:24:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 20:24:46.688218 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-c146de8a-faae-4cc0-a1eb-fbd529f13e93 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:24:46.689395 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-c146de8a-faae-4cc0-a1eb-fbd529f13e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:24:46.691328 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3752c-17c6-44fc-8917-51cf622735bf None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:24:46.697501 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 595/1166] 10.222.0.83 () {58 vars in 958 bytes} [Wed Jul 27 20:24:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 20:24:46.700586 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3752c-17c6-44fc-8917-51cf622735bf None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:24:46.701855 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146de8a-faae-4cc0-a1eb-fbd529f13e93 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:24:46.705237 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8d753-fa75-4b1d-bd14-822ca9e6c567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:24:46.705852 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8d753-fa75-4b1d-bd14-822ca9e6c567 admin admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:46.706132 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8d753-fa75-4b1d-bd14-822ca9e6c567 admin admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:46.706929 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8d753-fa75-4b1d-bd14-822ca9e6c567 admin admin] PATH_INFO: `/v3/domains` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:46.707659 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8d753-fa75-4b1d-bd14-822ca9e6c567 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:24:46.707963 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8d753-fa75-4b1d-bd14-822ca9e6c567 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:24:46.709551 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8d753-fa75-4b1d-bd14-822ca9e6c567 admin admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:24:46.711166 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146de8a-faae-4cc0-a1eb-fbd529f13e93 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:24:46.715619 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690410e-92ee-45ad-8b1d-1e6bb3ad96a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:24:46.716200 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690410e-92ee-45ad-8b1d-1e6bb3ad96a5 admin admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:46.716475 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690410e-92ee-45ad-8b1d-1e6bb3ad96a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:46.716740 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690410e-92ee-45ad-8b1d-1e6bb3ad96a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:46.717411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690410e-92ee-45ad-8b1d-1e6bb3ad96a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 20:24:46.717708 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690410e-92ee-45ad-8b1d-1e6bb3ad96a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:24:46.718695 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: WARNING py.warnings [None req-3690410e-92ee-45ad-8b1d-1e6bb3ad96a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:24:46.718695 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: warnings.warn(msg) Jul 27 20:24:46.718695 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: Jul 27 20:24:46.719659 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690410e-92ee-45ad-8b1d-1e6bb3ad96a5 admin admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:24:46.726625 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 572/1167] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Jul 27 20:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:24:46.730056 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8d753-fa75-4b1d-bd14-822ca9e6c567 admin admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:24:46.735807 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 596/1168] 10.222.0.83 () {58 vars in 1153 bytes} [Wed Jul 27 20:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 20:24:46.739795 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8d753-fa75-4b1d-bd14-822ca9e6c567 admin admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:24:46.743412 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690410e-92ee-45ad-8b1d-1e6bb3ad96a5 admin admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:24:46.744597 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2adf9d-3ef7-4c8d-8897-237328f04b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:24:46.745201 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2adf9d-3ef7-4c8d-8897-237328f04b9e admin admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:46.745482 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2adf9d-3ef7-4c8d-8897-237328f04b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:46.745754 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2adf9d-3ef7-4c8d-8897-237328f04b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:46.746408 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2adf9d-3ef7-4c8d-8897-237328f04b9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:24:46.747447 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: WARNING py.warnings [None req-0a2adf9d-3ef7-4c8d-8897-237328f04b9e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:24:46.747447 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: warnings.warn(msg) Jul 27 20:24:46.747447 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: Jul 27 20:24:46.748643 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2adf9d-3ef7-4c8d-8897-237328f04b9e admin admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:24:46.753500 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690410e-92ee-45ad-8b1d-1e6bb3ad96a5 admin admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:24:46.758298 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4788e41-52c3-436d-81e8-052f311d193f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:24:46.758902 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4788e41-52c3-436d-81e8-052f311d193f admin admin] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:46.759212 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4788e41-52c3-436d-81e8-052f311d193f admin admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:46.759506 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4788e41-52c3-436d-81e8-052f311d193f admin admin] PATH_INFO: `/v3/projects` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:46.760779 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4788e41-52c3-436d-81e8-052f311d193f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:24:46.762675 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4788e41-52c3-436d-81e8-052f311d193f admin admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:24:46.791631 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 573/1169] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Jul 27 20:24:46 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 20:24:46.792440 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2adf9d-3ef7-4c8d-8897-237328f04b9e admin admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:24:46.793794 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 597/1170] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Jul 27 20:24:46 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:24:46.797750 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4788e41-52c3-436d-81e8-052f311d193f admin admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:24:46.860608 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2adf9d-3ef7-4c8d-8897-237328f04b9e admin admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:24:46.861322 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4788e41-52c3-436d-81e8-052f311d193f admin admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:24:46.867703 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c47ce3-5667-4a9c-b6de-a5ad0d0fb82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:24:46.868240 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498a0ee-238e-4c75-b483-b4b2b2e91c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:24:46.868400 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c47ce3-5667-4a9c-b6de-a5ad0d0fb82c admin admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:46.868600 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c47ce3-5667-4a9c-b6de-a5ad0d0fb82c admin admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:46.868877 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c47ce3-5667-4a9c-b6de-a5ad0d0fb82c admin admin] PATH_INFO: `/v3/users` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:46.869020 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498a0ee-238e-4c75-b483-b4b2b2e91c87 admin admin] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:46.869385 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498a0ee-238e-4c75-b483-b4b2b2e91c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:46.869706 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498a0ee-238e-4c75-b483-b4b2b2e91c87 admin admin] PATH_INFO: `/v3/users` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:46.870151 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c47ce3-5667-4a9c-b6de-a5ad0d0fb82c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:24:46.870395 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498a0ee-238e-4c75-b483-b4b2b2e91c87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:24:46.871521 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: WARNING py.warnings [None req-4498a0ee-238e-4c75-b483-b4b2b2e91c87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:24:46.871521 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: warnings.warn(msg) Jul 27 20:24:46.871521 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: Jul 27 20:24:46.872101 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c47ce3-5667-4a9c-b6de-a5ad0d0fb82c admin admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:24:46.873135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498a0ee-238e-4c75-b483-b4b2b2e91c87 admin admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:24:46.898306 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 574/1171] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Jul 27 20:24:46 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 20:24:46.899275 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 598/1172] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Jul 27 20:24:46 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 20:24:46.904895 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c47ce3-5667-4a9c-b6de-a5ad0d0fb82c admin admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:24:46.905042 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498a0ee-238e-4c75-b483-b4b2b2e91c87 admin admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:24:46.918641 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c47ce3-5667-4a9c-b6de-a5ad0d0fb82c admin admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:24:46.919117 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498a0ee-238e-4c75-b483-b4b2b2e91c87 admin admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:24:46.923354 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7b0ba-3075-4415-a730-d5aa13b878b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:24:46.923843 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd9c92-e745-4cc2-972c-f22fbe62988b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:24:46.923983 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7b0ba-3075-4415-a730-d5aa13b878b7 admin admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:46.924247 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7b0ba-3075-4415-a730-d5aa13b878b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:46.924469 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd9c92-e745-4cc2-972c-f22fbe62988b admin admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:46.924568 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7b0ba-3075-4415-a730-d5aa13b878b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:46.924743 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd9c92-e745-4cc2-972c-f22fbe62988b admin admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:46.925025 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd9c92-e745-4cc2-972c-f22fbe62988b admin admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:46.925202 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7b0ba-3075-4415-a730-d5aa13b878b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:24:46.925736 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd9c92-e745-4cc2-972c-f22fbe62988b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:24:46.926899 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7b0ba-3075-4415-a730-d5aa13b878b7 admin admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:24:46.927383 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd9c92-e745-4cc2-972c-f22fbe62988b admin admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:24:46.937973 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 575/1173] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Jul 27 20:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 20:24:46.941143 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 599/1174] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Jul 27 20:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 20:24:46.942701 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7b0ba-3075-4415-a730-d5aa13b878b7 admin admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:24:46.945016 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd9c92-e745-4cc2-972c-f22fbe62988b admin admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:24:46.953060 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7b0ba-3075-4415-a730-d5aa13b878b7 admin admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:24:46.954781 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd9c92-e745-4cc2-972c-f22fbe62988b admin admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:24:46.959991 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138c73a-d2bc-4ac1-b051-27e29a8c6151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:24:46.960156 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3e65a-de51-416e-a4f1-cd99480fd637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:24:46.960613 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138c73a-d2bc-4ac1-b051-27e29a8c6151 admin admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:46.960724 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3e65a-de51-416e-a4f1-cd99480fd637 admin admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:46.960890 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3e65a-de51-416e-a4f1-cd99480fd637 admin admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:46.960984 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138c73a-d2bc-4ac1-b051-27e29a8c6151 admin admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:46.961159 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3e65a-de51-416e-a4f1-cd99480fd637 admin admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:46.961259 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138c73a-d2bc-4ac1-b051-27e29a8c6151 admin admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:46.961869 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3e65a-de51-416e-a4f1-cd99480fd637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:24:46.961978 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138c73a-d2bc-4ac1-b051-27e29a8c6151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:24:46.963532 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138c73a-d2bc-4ac1-b051-27e29a8c6151 admin admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:24:46.964150 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3e65a-de51-416e-a4f1-cd99480fd637 admin admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:24:46.974478 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 600/1175] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Jul 27 20:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 20:24:46.978476 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 576/1176] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Jul 27 20:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 20:24:46.979335 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3e65a-de51-416e-a4f1-cd99480fd637 admin admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:24:46.981566 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138c73a-d2bc-4ac1-b051-27e29a8c6151 admin admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:24:46.990831 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3e65a-de51-416e-a4f1-cd99480fd637 admin admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:24:46.991466 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138c73a-d2bc-4ac1-b051-27e29a8c6151 admin admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:24:46.995410 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a8d8a-d6e4-476a-88d3-49255fc48f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:24:46.995922 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21743b76-f1fa-4aff-957a-521df2053156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:24:46.996066 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a8d8a-d6e4-476a-88d3-49255fc48f3c admin admin] REQUEST_METHOD: `PUT` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:46.996358 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a8d8a-d6e4-476a-88d3-49255fc48f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:46.996572 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21743b76-f1fa-4aff-957a-521df2053156 admin admin] REQUEST_METHOD: `PUT` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:46.996681 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a8d8a-d6e4-476a-88d3-49255fc48f3c admin admin] PATH_INFO: `/v3/projects/13f7ef2b0f4948ab8659329446ce6fee/users/a198f11ad00e442ab5705502607ef30e/roles/13a38ce5696549bf95272ffae43798c8` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:46.996849 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21743b76-f1fa-4aff-957a-521df2053156 admin admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:46.997237 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21743b76-f1fa-4aff-957a-521df2053156 admin admin] PATH_INFO: `/v3/projects/3c50ef6e43904fdc9a5a8666778f69f3/users/558a217004b94021b2022b258b0b023a/roles/13a38ce5696549bf95272ffae43798c8` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:47.011643 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a8d8a-d6e4-476a-88d3-49255fc48f3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=13f7ef2b0f4948ab8659329446ce6fee, user_id=a198f11ad00e442ab5705502607ef30e, role_id=13a38ce5696549bf95272ffae43798c8)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:24:47.013338 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21743b76-f1fa-4aff-957a-521df2053156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c50ef6e43904fdc9a5a8666778f69f3, user_id=558a217004b94021b2022b258b0b023a, role_id=13a38ce5696549bf95272ffae43798c8)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:24:47.014308 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a8d8a-d6e4-476a-88d3-49255fc48f3c admin admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:24:47.014420 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: WARNING py.warnings [None req-21743b76-f1fa-4aff-957a-521df2053156 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:24:47.014420 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: warnings.warn(msg) Jul 27 20:24:47.014420 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: Jul 27 20:24:47.016322 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21743b76-f1fa-4aff-957a-521df2053156 admin admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:24:47.029473 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 601/1177] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Jul 27 20:24:46 2022] PUT /identity/v3/projects/13f7ef2b0f4948ab8659329446ce6fee/users/a198f11ad00e442ab5705502607ef30e/roles/13a38ce5696549bf95272ffae43798c8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:24:47.030955 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 577/1178] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Jul 27 20:24:46 2022] PUT /identity/v3/projects/3c50ef6e43904fdc9a5a8666778f69f3/users/558a217004b94021b2022b258b0b023a/roles/13a38ce5696549bf95272ffae43798c8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 20:24:47.034817 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11134435-de73-446c-8384-03210e136e96 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:47.035266 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11134435-de73-446c-8384-03210e136e96 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:47.035549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11134435-de73-446c-8384-03210e136e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:47.035840 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb596cb-4c7c-4b04-a949-6f29b9c1295e None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:47.036129 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb596cb-4c7c-4b04-a949-6f29b9c1295e None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:47.036407 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb596cb-4c7c-4b04-a949-6f29b9c1295e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:47.053717 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-11134435-de73-446c-8384-03210e136e96 None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:24:47.054918 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-11134435-de73-446c-8384-03210e136e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:24:47.055045 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-deb596cb-4c7c-4b04-a949-6f29b9c1295e None None] MFA Rules not processed for user `5c55d2b6170e4e2782d526caffb1c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:24:47.056403 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-deb596cb-4c7c-4b04-a949-6f29b9c1295e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:24:47.098655 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:24:47.103179 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:24:47.115790 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 602/1179] 10.222.0.83 () {58 vars in 958 bytes} [Wed Jul 27 20:24:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:24:47.121048 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 578/1180] 10.222.0.83 () {58 vars in 958 bytes} [Wed Jul 27 20:24:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 20:24:47.126409 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11134435-de73-446c-8384-03210e136e96 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:24:47.131606 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb596cb-4c7c-4b04-a949-6f29b9c1295e None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:24:47.133148 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-deb596cb-4c7c-4b04-a949-6f29b9c1295e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:24:47.181973 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11134435-de73-446c-8384-03210e136e96 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:24:47.185597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1144f-2b25-4f32-b842-2e79ae076772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:24:47.186216 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1144f-2b25-4f32-b842-2e79ae076772 service neutron] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:47.186492 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1144f-2b25-4f32-b842-2e79ae076772 service neutron] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:47.186763 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1144f-2b25-4f32-b842-2e79ae076772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:47.196712 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1144f-2b25-4f32-b842-2e79ae076772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:24:47.198145 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1144f-2b25-4f32-b842-2e79ae076772 service neutron] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:24:47.204572 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb596cb-4c7c-4b04-a949-6f29b9c1295e None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:24:47.208156 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 603/1181] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:24:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:24:47.209923 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1079973-a5a5-4775-8a03-36896aba3743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:24:47.210552 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1079973-a5a5-4775-8a03-36896aba3743 service neutron] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:47.210829 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1079973-a5a5-4775-8a03-36896aba3743 service neutron] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:47.211138 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1079973-a5a5-4775-8a03-36896aba3743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:47.220477 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1079973-a5a5-4775-8a03-36896aba3743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:24:47.223016 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1079973-a5a5-4775-8a03-36896aba3743 service neutron] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:24:47.234009 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 579/1182] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:24:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 20:24:53.075063 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03400bc-d9a7-497d-b601-5ae770978825 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:53.075662 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03400bc-d9a7-497d-b601-5ae770978825 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:53.075662 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03400bc-d9a7-497d-b601-5ae770978825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:53.138844 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-d03400bc-d9a7-497d-b601-5ae770978825 None None] MFA Rules not processed for user `558a217004b94021b2022b258b0b023a`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:24:53.140190 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-d03400bc-d9a7-497d-b601-5ae770978825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:24:53.295364 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 604/1183] 10.222.0.83 () {58 vars in 958 bytes} [Wed Jul 27 20:24:53 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:24:53.298104 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1079973-a5a5-4775-8a03-36896aba3743 service neutron] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:24:53.313092 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1079973-a5a5-4775-8a03-36896aba3743 service neutron] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:24:53.326034 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f410c0-d979-4b91-9706-48e660c99622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:24:53.327039 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f410c0-d979-4b91-9706-48e660c99622 admin admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:53.327679 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f410c0-d979-4b91-9706-48e660c99622 admin admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:53.328211 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f410c0-d979-4b91-9706-48e660c99622 admin admin] PATH_INFO: `/v3/projects` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:53.329262 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f410c0-d979-4b91-9706-48e660c99622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:24:53.339023 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f410c0-d979-4b91-9706-48e660c99622 admin admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:24:53.398521 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19679c6f-a4d0-4147-b62a-ec768756bacf None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:53.398735 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19679c6f-a4d0-4147-b62a-ec768756bacf None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:53.399015 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19679c6f-a4d0-4147-b62a-ec768756bacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:53.435592 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 580/1184] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Jul 27 20:24:53 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 20:24:53.442365 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f410c0-d979-4b91-9706-48e660c99622 admin admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:24:53.446742 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-19679c6f-a4d0-4147-b62a-ec768756bacf None None] MFA Rules not processed for user `a198f11ad00e442ab5705502607ef30e`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:24:53.448017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-19679c6f-a4d0-4147-b62a-ec768756bacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:24:53.555058 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f410c0-d979-4b91-9706-48e660c99622 admin admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:24:53.558574 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 605/1185] 10.222.0.83 () {58 vars in 958 bytes} [Wed Jul 27 20:24:53 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:24:53.559718 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19679c6f-a4d0-4147-b62a-ec768756bacf None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:24:53.561790 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d310df-775c-4b6d-b4a8-a3bffbe13703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:24:53.562433 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d310df-775c-4b6d-b4a8-a3bffbe13703 admin admin] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:53.562716 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d310df-775c-4b6d-b4a8-a3bffbe13703 admin admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:53.562999 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d310df-775c-4b6d-b4a8-a3bffbe13703 admin admin] PATH_INFO: `/v3/users` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:53.563705 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d310df-775c-4b6d-b4a8-a3bffbe13703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:24:53.573970 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d310df-775c-4b6d-b4a8-a3bffbe13703 admin admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:24:53.574852 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19679c6f-a4d0-4147-b62a-ec768756bacf None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:24:53.589511 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354de76e-c88e-40e6-ac39-0dbfc2fcf0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:24:53.590402 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354de76e-c88e-40e6-ac39-0dbfc2fcf0f7 admin admin] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:53.590926 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354de76e-c88e-40e6-ac39-0dbfc2fcf0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:53.591326 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354de76e-c88e-40e6-ac39-0dbfc2fcf0f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:53.592056 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354de76e-c88e-40e6-ac39-0dbfc2fcf0f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:24:53.594106 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354de76e-c88e-40e6-ac39-0dbfc2fcf0f7 admin admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:24:53.607735 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 581/1186] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Jul 27 20:24:53 2022] POST /identity/v3/users => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 20:24:53.613855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d310df-775c-4b6d-b4a8-a3bffbe13703 admin admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:24:53.618340 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:24:53.626723 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d310df-775c-4b6d-b4a8-a3bffbe13703 admin admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:24:53.633096 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620b039-90cd-4e09-aeb8-449453c605d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:24:53.633667 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620b039-90cd-4e09-aeb8-449453c605d6 admin admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:53.633962 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620b039-90cd-4e09-aeb8-449453c605d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:53.634231 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620b039-90cd-4e09-aeb8-449453c605d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:53.634958 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620b039-90cd-4e09-aeb8-449453c605d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:24:53.636805 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620b039-90cd-4e09-aeb8-449453c605d6 admin admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:24:53.644660 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 606/1187] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Jul 27 20:24:53 2022] POST /identity/v3/projects => generated 377 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 20:24:53.648906 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354de76e-c88e-40e6-ac39-0dbfc2fcf0f7 admin admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:24:53.650970 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 582/1188] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Jul 27 20:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 20:24:53.654660 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620b039-90cd-4e09-aeb8-449453c605d6 admin admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:24:53.667039 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620b039-90cd-4e09-aeb8-449453c605d6 admin admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:24:53.710507 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:24:53.733568 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354de76e-c88e-40e6-ac39-0dbfc2fcf0f7 admin admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:24:53.739530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29174639-0a63-4e54-b4d5-b4e563ffd48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:24:53.739717 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ae059-cab8-44d4-93a5-46e9e114a116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:24:53.740224 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29174639-0a63-4e54-b4d5-b4e563ffd48f admin admin] REQUEST_METHOD: `PUT` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:53.740360 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ae059-cab8-44d4-93a5-46e9e114a116 admin admin] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:53.740580 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29174639-0a63-4e54-b4d5-b4e563ffd48f admin admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:53.740685 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ae059-cab8-44d4-93a5-46e9e114a116 admin admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:53.740772 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29174639-0a63-4e54-b4d5-b4e563ffd48f admin admin] PATH_INFO: `/v3/projects/2578d041e1084901a2b7f0fe79d00116/users/adc782c099ee4b74b9541836a620b7ff/roles/df8ec36d044b469d8854eba8394eb107` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:53.740936 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ae059-cab8-44d4-93a5-46e9e114a116 admin admin] PATH_INFO: `/v3/users` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:53.741625 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ae059-cab8-44d4-93a5-46e9e114a116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:24:53.743921 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ae059-cab8-44d4-93a5-46e9e114a116 admin admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:24:53.757293 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29174639-0a63-4e54-b4d5-b4e563ffd48f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2578d041e1084901a2b7f0fe79d00116, user_id=adc782c099ee4b74b9541836a620b7ff, role_id=df8ec36d044b469d8854eba8394eb107)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:24:53.760251 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29174639-0a63-4e54-b4d5-b4e563ffd48f admin admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:24:53.769742 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 607/1189] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Jul 27 20:24:53 2022] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 20:24:53.774691 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ae059-cab8-44d4-93a5-46e9e114a116 admin admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:24:53.781434 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 583/1190] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Jul 27 20:24:53 2022] PUT /identity/v3/projects/2578d041e1084901a2b7f0fe79d00116/users/adc782c099ee4b74b9541836a620b7ff/roles/df8ec36d044b469d8854eba8394eb107 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 20:24:53.786003 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29174639-0a63-4e54-b4d5-b4e563ffd48f admin admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:24:53.788372 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ae059-cab8-44d4-93a5-46e9e114a116 admin admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:24:53.849475 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497fb6e-0abd-4d45-9bb2-5e330f860b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:24:53.850122 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497fb6e-0abd-4d45-9bb2-5e330f860b6d admin admin] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:53.850402 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497fb6e-0abd-4d45-9bb2-5e330f860b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:53.850676 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497fb6e-0abd-4d45-9bb2-5e330f860b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:53.851407 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497fb6e-0abd-4d45-9bb2-5e330f860b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:24:53.853079 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497fb6e-0abd-4d45-9bb2-5e330f860b6d admin admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:24:53.859420 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29174639-0a63-4e54-b4d5-b4e563ffd48f admin admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:24:53.864259 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 608/1191] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Jul 27 20:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 20:24:53.868339 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a1d53-25cc-4aaa-9b18-5949d0552b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:24:53.868989 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a1d53-25cc-4aaa-9b18-5949d0552b91 admin admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:53.869271 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a1d53-25cc-4aaa-9b18-5949d0552b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:53.869573 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a1d53-25cc-4aaa-9b18-5949d0552b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:53.870278 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a1d53-25cc-4aaa-9b18-5949d0552b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:24:53.871975 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a1d53-25cc-4aaa-9b18-5949d0552b91 admin admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:24:53.873007 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497fb6e-0abd-4d45-9bb2-5e330f860b6d admin admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:24:53.884235 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497fb6e-0abd-4d45-9bb2-5e330f860b6d admin admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:24:53.884990 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 584/1192] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Jul 27 20:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 20:24:53.888964 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a1d53-25cc-4aaa-9b18-5949d0552b91 admin admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:24:53.890246 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51b4aa-33ca-4ac2-a150-720c5407d501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:24:53.890950 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51b4aa-33ca-4ac2-a150-720c5407d501 admin admin] REQUEST_METHOD: `PUT` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:53.891258 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51b4aa-33ca-4ac2-a150-720c5407d501 admin admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:53.891532 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51b4aa-33ca-4ac2-a150-720c5407d501 admin admin] PATH_INFO: `/v3/projects/a34478698f2744b49e3999d7661b51b5/users/1d64eedb78304e639f8a449e3de7bf5e/roles/df8ec36d044b469d8854eba8394eb107` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:53.900269 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a1d53-25cc-4aaa-9b18-5949d0552b91 admin admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:24:53.905710 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29437e93-9f5a-49d6-bced-c08ac70f38d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:24:53.906551 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29437e93-9f5a-49d6-bced-c08ac70f38d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:53.906964 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29437e93-9f5a-49d6-bced-c08ac70f38d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:53.907371 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29437e93-9f5a-49d6-bced-c08ac70f38d5 admin admin] PATH_INFO: `/v3/projects/2578d041e1084901a2b7f0fe79d00116/users/adc782c099ee4b74b9541836a620b7ff/roles/df8ec36d044b469d8854eba8394eb107` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:53.910495 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29437e93-9f5a-49d6-bced-c08ac70f38d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2578d041e1084901a2b7f0fe79d00116, user_id=adc782c099ee4b74b9541836a620b7ff, role_id=df8ec36d044b469d8854eba8394eb107)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:24:53.913346 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29437e93-9f5a-49d6-bced-c08ac70f38d5 admin admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:24:53.920230 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51b4aa-33ca-4ac2-a150-720c5407d501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34478698f2744b49e3999d7661b51b5, user_id=1d64eedb78304e639f8a449e3de7bf5e, role_id=df8ec36d044b469d8854eba8394eb107)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:24:53.923090 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51b4aa-33ca-4ac2-a150-720c5407d501 admin admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:24:53.927218 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 585/1193] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Jul 27 20:24:53 2022] PUT /identity/v3/projects/2578d041e1084901a2b7f0fe79d00116/users/adc782c099ee4b74b9541836a620b7ff/roles/df8ec36d044b469d8854eba8394eb107 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:24:53.944697 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 609/1194] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Jul 27 20:24:53 2022] PUT /identity/v3/projects/a34478698f2744b49e3999d7661b51b5/users/1d64eedb78304e639f8a449e3de7bf5e/roles/df8ec36d044b469d8854eba8394eb107 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:24:53.945712 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29437e93-9f5a-49d6-bced-c08ac70f38d5 admin admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:24:54.062034 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29437e93-9f5a-49d6-bced-c08ac70f38d5 admin admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:24:54.126241 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:24:54.150949 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb4879-5245-46c4-aede-9d2167572e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:24:54.151741 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb4879-5245-46c4-aede-9d2167572e4b admin admin] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:54.152095 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb4879-5245-46c4-aede-9d2167572e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:54.152591 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb4879-5245-46c4-aede-9d2167572e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:54.154032 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb4879-5245-46c4-aede-9d2167572e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:24:54.155908 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb4879-5245-46c4-aede-9d2167572e4b admin admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:24:54.171952 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 586/1195] 10.222.0.83 () {58 vars in 1122 bytes} [Wed Jul 27 20:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 20:24:54.176440 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51b4aa-33ca-4ac2-a150-720c5407d501 admin admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:24:54.192316 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51b4aa-33ca-4ac2-a150-720c5407d501 admin admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:24:54.197942 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fcf00-1f05-4c5d-85bb-f896c3343f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:24:54.198710 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fcf00-1f05-4c5d-85bb-f896c3343f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:54.199066 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fcf00-1f05-4c5d-85bb-f896c3343f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:54.199455 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fcf00-1f05-4c5d-85bb-f896c3343f0f admin admin] PATH_INFO: `/v3/projects/a34478698f2744b49e3999d7661b51b5/users/1d64eedb78304e639f8a449e3de7bf5e/roles/df8ec36d044b469d8854eba8394eb107` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:24:54.201525 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fcf00-1f05-4c5d-85bb-f896c3343f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34478698f2744b49e3999d7661b51b5, user_id=1d64eedb78304e639f8a449e3de7bf5e, role_id=df8ec36d044b469d8854eba8394eb107)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:24:54.204326 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fcf00-1f05-4c5d-85bb-f896c3343f0f admin admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:24:54.218435 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 610/1196] 10.222.0.83 () {60 vars in 1483 bytes} [Wed Jul 27 20:24:54 2022] PUT /identity/v3/projects/a34478698f2744b49e3999d7661b51b5/users/1d64eedb78304e639f8a449e3de7bf5e/roles/df8ec36d044b469d8854eba8394eb107 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 20:24:59.931045 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888469e-aaed-4519-8458-5e8ffe4d03cb None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:24:59.931636 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888469e-aaed-4519-8458-5e8ffe4d03cb None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:24:59.931636 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888469e-aaed-4519-8458-5e8ffe4d03cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:00.004417 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-b888469e-aaed-4519-8458-5e8ffe4d03cb None None] MFA Rules not processed for user `adc782c099ee4b74b9541836a620b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:25:00.005655 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-b888469e-aaed-4519-8458-5e8ffe4d03cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:25:00.165072 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 587/1197] 10.222.0.83 () {58 vars in 958 bytes} [Wed Jul 27 20:24:59 2022] POST /identity/v3/auth/tokens => generated 2877 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 20:25:00.180498 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fcf00-1f05-4c5d-85bb-f896c3343f0f admin admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:25:00.183653 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-3b7fcf00-1f05-4c5d-85bb-f896c3343f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:25:00.315936 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:00.379214 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fcf00-1f05-4c5d-85bb-f896c3343f0f admin admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:25:00.383706 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9808ce-b898-46db-b6e3-7219b31e63ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04dc74146aed49cb98441ea945847379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:25:00.387843 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9808ce-b898-46db-b6e3-7219b31e63ad service glance] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:00.388410 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9808ce-b898-46db-b6e3-7219b31e63ad service glance] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:00.388882 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9808ce-b898-46db-b6e3-7219b31e63ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:00.604926 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9808ce-b898-46db-b6e3-7219b31e63ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:25:00.606466 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9808ce-b898-46db-b6e3-7219b31e63ad service glance] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:25:00.654486 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 611/1198] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:25:00 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:25:00.769543 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e425a-04d5-46bf-a427-d0184c0c55a8 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:00.769819 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e425a-04d5-46bf-a427-d0184c0c55a8 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:00.770097 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e425a-04d5-46bf-a427-d0184c0c55a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:00.820698 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-cf8e425a-04d5-46bf-a427-d0184c0c55a8 None None] MFA Rules not processed for user `1d64eedb78304e639f8a449e3de7bf5e`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:25:00.822303 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-cf8e425a-04d5-46bf-a427-d0184c0c55a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:25:01.011714 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 588/1199] 10.222.0.83 () {58 vars in 958 bytes} [Wed Jul 27 20:25:00 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:25:01.028602 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9808ce-b898-46db-b6e3-7219b31e63ad service glance] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:25:01.054198 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9808ce-b898-46db-b6e3-7219b31e63ad service glance] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:25:01.071055 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2dde6f-5b05-49ef-bda6-56d50ff9f5fd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04dc74146aed49cb98441ea945847379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:25:01.072162 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dde6f-5b05-49ef-bda6-56d50ff9f5fd service glance] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:01.072445 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dde6f-5b05-49ef-bda6-56d50ff9f5fd service glance] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:01.072720 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dde6f-5b05-49ef-bda6-56d50ff9f5fd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:01.165554 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2dde6f-5b05-49ef-bda6-56d50ff9f5fd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:25:01.167434 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2dde6f-5b05-49ef-bda6-56d50ff9f5fd service glance] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:25:01.185400 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 612/1200] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:25:01 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:25:09.770057 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef02a6-61e1-4d26-a856-edba4ac6da27 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:09.770954 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef02a6-61e1-4d26-a856-edba4ac6da27 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:09.770954 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef02a6-61e1-4d26-a856-edba4ac6da27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:09.793147 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-63ef02a6-61e1-4d26-a856-edba4ac6da27 None None] MFA Rules not processed for user `558a217004b94021b2022b258b0b023a`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:25:09.794361 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-63ef02a6-61e1-4d26-a856-edba4ac6da27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:25:09.801959 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 589/1201] 10.222.0.83 () {58 vars in 958 bytes} [Wed Jul 27 20:25:09 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:25:10.101206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f6b62-e4e4-438c-9866-5c7d53687c1d None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:10.101886 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f6b62-e4e4-438c-9866-5c7d53687c1d None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:10.101886 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f6b62-e4e4-438c-9866-5c7d53687c1d None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:10.103215 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 613/1202] 10.222.0.83 () {54 vars in 962 bytes} [Wed Jul 27 20:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:25:10.109534 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed2279-d2d7-4b2e-ac5e-1839a0f0cddb None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:10.109851 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed2279-d2d7-4b2e-ac5e-1839a0f0cddb None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:10.110125 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed2279-d2d7-4b2e-ac5e-1839a0f0cddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:10.144537 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-3fed2279-d2d7-4b2e-ac5e-1839a0f0cddb None None] MFA Rules not processed for user `f68b37524d7245e4b606ad8dd15442ef`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:25:10.145755 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-3fed2279-d2d7-4b2e-ac5e-1839a0f0cddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:25:10.179322 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=100 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:10.212611 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 590/1203] 10.222.0.83 () {58 vars in 1059 bytes} [Wed Jul 27 20:25:10 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:25:10.217951 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733eb18-c04c-465f-a9c6-bae3cfb61b32 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:10.218236 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733eb18-c04c-465f-a9c6-bae3cfb61b32 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:10.218507 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733eb18-c04c-465f-a9c6-bae3cfb61b32 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:10.219859 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 614/1204] 10.222.0.83 () {54 vars in 912 bytes} [Wed Jul 27 20:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:25:10.225093 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf91950-6700-4965-9373-fe08da4e0faa None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:10.225389 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf91950-6700-4965-9373-fe08da4e0faa None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:10.225669 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf91950-6700-4965-9373-fe08da4e0faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:10.245860 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-dbf91950-6700-4965-9373-fe08da4e0faa None None] MFA Rules not processed for user `f68b37524d7245e4b606ad8dd15442ef`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:25:10.247063 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-dbf91950-6700-4965-9373-fe08da4e0faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:25:10.256411 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 591/1205] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Jul 27 20:25:10 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:25:10.273634 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733eb18-c04c-465f-a9c6-bae3cfb61b32 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:25:10.275515 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-1733eb18-c04c-465f-a9c6-bae3cfb61b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:25:10.290457 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733eb18-c04c-465f-a9c6-bae3cfb61b32 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:25:10.295333 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b6a30-bc04-48e2-82a5-2e7b6ef6be56 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04dc74146aed49cb98441ea945847379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:25:10.296234 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b6a30-bc04-48e2-82a5-2e7b6ef6be56 service glance] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:10.297358 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b6a30-bc04-48e2-82a5-2e7b6ef6be56 service glance] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:10.297358 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b6a30-bc04-48e2-82a5-2e7b6ef6be56 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:10.318492 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b6a30-bc04-48e2-82a5-2e7b6ef6be56 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:25:10.319936 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b6a30-bc04-48e2-82a5-2e7b6ef6be56 service glance] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:25:10.331845 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 615/1206] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:25:10 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:25:10.693930 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b0c1d-2199-4b8f-9d96-7ce929b2806e None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:10.694254 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b0c1d-2199-4b8f-9d96-7ce929b2806e None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:10.694489 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b0c1d-2199-4b8f-9d96-7ce929b2806e None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:10.695873 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 592/1207] 10.222.0.83 () {54 vars in 912 bytes} [Wed Jul 27 20:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:25:10.701182 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25494b-6616-4016-b5ef-17521a88bbfc None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:10.701471 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25494b-6616-4016-b5ef-17521a88bbfc None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:10.701751 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25494b-6616-4016-b5ef-17521a88bbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:10.721933 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-3d25494b-6616-4016-b5ef-17521a88bbfc None None] MFA Rules not processed for user `308f029a3e7b46fbaff75a01720c8986`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:25:10.723306 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-3d25494b-6616-4016-b5ef-17521a88bbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:25:10.780518 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 616/1208] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Jul 27 20:25:10 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 20:25:10.793780 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b0c1d-2199-4b8f-9d96-7ce929b2806e None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:25:10.807221 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b0c1d-2199-4b8f-9d96-7ce929b2806e None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:25:10.812092 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ed2d3-d7c7-4f91-961a-8787cae77435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:25:10.812784 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ed2d3-d7c7-4f91-961a-8787cae77435 service neutron] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:10.813074 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ed2d3-d7c7-4f91-961a-8787cae77435 service neutron] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:10.813349 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ed2d3-d7c7-4f91-961a-8787cae77435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:10.822030 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ed2d3-d7c7-4f91-961a-8787cae77435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:25:10.823767 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ed2d3-d7c7-4f91-961a-8787cae77435 service neutron] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:25:10.832616 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 593/1209] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:25:10 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:25:11.301081 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e82f66-e92a-4e72-81ff-60072532f985 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:11.301477 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e82f66-e92a-4e72-81ff-60072532f985 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:11.301783 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e82f66-e92a-4e72-81ff-60072532f985 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:11.303356 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 617/1210] 10.222.0.83 () {54 vars in 962 bytes} [Wed Jul 27 20:25:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:25:11.319019 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358215e5-6593-4cfb-aebf-24cab375d4ed None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:11.319876 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358215e5-6593-4cfb-aebf-24cab375d4ed None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:11.319876 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358215e5-6593-4cfb-aebf-24cab375d4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:11.344835 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-358215e5-6593-4cfb-aebf-24cab375d4ed None None] MFA Rules not processed for user `f68b37524d7245e4b606ad8dd15442ef`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:25:11.346893 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-358215e5-6593-4cfb-aebf-24cab375d4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:25:11.363621 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524618d-bd20-46db-9076-c70792e1db98 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:11.364043 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524618d-bd20-46db-9076-c70792e1db98 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:11.364332 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524618d-bd20-46db-9076-c70792e1db98 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:11.366340 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 618/1212] 10.222.0.83 () {54 vars in 912 bytes} [Wed Jul 27 20:25:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:25:11.369689 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabb6c1-c2b0-42f5-be54-aca99e15c798 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:11.370205 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabb6c1-c2b0-42f5-be54-aca99e15c798 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:11.372077 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabb6c1-c2b0-42f5-be54-aca99e15c798 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:11.375286 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 619/1213] 10.222.0.83 () {54 vars in 961 bytes} [Wed Jul 27 20:25:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:25:11.378759 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5abe30-70ba-4a44-95a5-1ca7aef28c81 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:11.379289 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5abe30-70ba-4a44-95a5-1ca7aef28c81 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:11.379637 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5abe30-70ba-4a44-95a5-1ca7aef28c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:11.380151 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 594/1213] 10.222.0.83 () {58 vars in 1059 bytes} [Wed Jul 27 20:25:11 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 20:25:11.383521 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4575a6e-0a8b-4b20-a5c2-1447fa7353ef None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:11.383521 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4575a6e-0a8b-4b20-a5c2-1447fa7353ef None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:11.383773 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4575a6e-0a8b-4b20-a5c2-1447fa7353ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:11.420439 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-e4575a6e-0a8b-4b20-a5c2-1447fa7353ef None None] MFA Rules not processed for user `733839729aa249e0823f24a8e8fb3ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:25:11.422411 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-e4575a6e-0a8b-4b20-a5c2-1447fa7353ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:25:11.424321 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-6e5abe30-70ba-4a44-95a5-1ca7aef28c81 None None] MFA Rules not processed for user `f68b37524d7245e4b606ad8dd15442ef`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:25:11.425522 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-6e5abe30-70ba-4a44-95a5-1ca7aef28c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:25:11.436175 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 620/1214] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Jul 27 20:25:11 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:25:11.450601 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5abe30-70ba-4a44-95a5-1ca7aef28c81 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:25:11.464167 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5abe30-70ba-4a44-95a5-1ca7aef28c81 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:25:11.487593 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc49dac-89da-4272-acb7-932645b2cf18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:25:11.488254 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc49dac-89da-4272-acb7-932645b2cf18 service neutron] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:11.491348 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc49dac-89da-4272-acb7-932645b2cf18 service neutron] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:11.491793 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc49dac-89da-4272-acb7-932645b2cf18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:11.513193 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 595/1215] 10.222.0.83 () {58 vars in 1058 bytes} [Wed Jul 27 20:25:11 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:25:11.525082 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc49dac-89da-4272-acb7-932645b2cf18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:25:11.527113 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc49dac-89da-4272-acb7-932645b2cf18 service neutron] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:25:11.528307 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4575a6e-0a8b-4b20-a5c2-1447fa7353ef None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:25:11.541061 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4575a6e-0a8b-4b20-a5c2-1447fa7353ef None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:25:11.547533 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 621/1216] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:25:11 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:25:11.547723 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00300283-554e-4258-a42d-1c8c33e0d7a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733839729aa249e0823f24a8e8fb3ffe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:25:11.548591 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00300283-554e-4258-a42d-1c8c33e0d7a6 service placement] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:11.548980 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00300283-554e-4258-a42d-1c8c33e0d7a6 service placement] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:11.549824 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00300283-554e-4258-a42d-1c8c33e0d7a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:11.552402 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-00300283-554e-4258-a42d-1c8c33e0d7a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:25:11.581198 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00300283-554e-4258-a42d-1c8c33e0d7a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:25:11.582922 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00300283-554e-4258-a42d-1c8c33e0d7a6 service placement] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:25:11.615626 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 596/1217] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:25:11 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:25:21.535735 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=99 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:21.600729 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=59 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:22.903011 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c33835-67ee-47ef-8795-4d7cc33739af None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:22.903566 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c33835-67ee-47ef-8795-4d7cc33739af None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:22.903675 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c33835-67ee-47ef-8795-4d7cc33739af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:22.928516 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-53c33835-67ee-47ef-8795-4d7cc33739af None None] MFA Rules not processed for user `308f029a3e7b46fbaff75a01720c8986`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:25:22.939092 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-53c33835-67ee-47ef-8795-4d7cc33739af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:25:22.939092 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 622/1218] 10.222.0.84 () {58 vars in 1015 bytes} [Wed Jul 27 20:25:22 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:25:22.948957 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00300283-554e-4258-a42d-1c8c33e0d7a6 service placement] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:25:22.958638 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00300283-554e-4258-a42d-1c8c33e0d7a6 service placement] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:25:22.962318 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8dc82a-c95c-4857-bc66-07c102de9c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:25:22.962932 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dc82a-c95c-4857-bc66-07c102de9c4f service neutron] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:22.963254 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dc82a-c95c-4857-bc66-07c102de9c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:22.963528 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dc82a-c95c-4857-bc66-07c102de9c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:22.971320 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8dc82a-c95c-4857-bc66-07c102de9c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:25:22.972750 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8dc82a-c95c-4857-bc66-07c102de9c4f service neutron] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:25:22.980910 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 597/1219] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:25:22 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:25:23.750251 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8806b4-3b37-4b25-a12e-ced96f85dab8 None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:23.751164 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8806b4-3b37-4b25-a12e-ced96f85dab8 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:23.751408 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8806b4-3b37-4b25-a12e-ced96f85dab8 None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:23.753201 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 623/1220] 10.222.0.83 () {54 vars in 921 bytes} [Wed Jul 27 20:25:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:25:23.792694 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9966d-ba01-47a5-820c-270ba5ad5aa1 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:23.793235 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9966d-ba01-47a5-820c-270ba5ad5aa1 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:23.793617 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9966d-ba01-47a5-820c-270ba5ad5aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:23.828325 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-0aa9966d-ba01-47a5-820c-270ba5ad5aa1 None None] MFA Rules not processed for user `f68b37524d7245e4b606ad8dd15442ef`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:25:23.830137 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-0aa9966d-ba01-47a5-820c-270ba5ad5aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:25:23.857828 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 598/1221] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Jul 27 20:25:23 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:25:23.881542 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8806b4-3b37-4b25-a12e-ced96f85dab8 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:25:23.898372 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8806b4-3b37-4b25-a12e-ced96f85dab8 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:25:23.905334 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62909d1-8812-4df6-a07f-653f59ad6405 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:25:23.906035 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62909d1-8812-4df6-a07f-653f59ad6405 service nova] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:23.906352 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62909d1-8812-4df6-a07f-653f59ad6405 service nova] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:23.906633 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62909d1-8812-4df6-a07f-653f59ad6405 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:23.919735 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62909d1-8812-4df6-a07f-653f59ad6405 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:25:23.921383 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62909d1-8812-4df6-a07f-653f59ad6405 service nova] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:25:23.932462 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 624/1222] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:25:23 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:25:31.525528 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bc2bb-e704-421f-8e60-546f315685d1 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:31.525528 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bc2bb-e704-421f-8e60-546f315685d1 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:31.526223 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bc2bb-e704-421f-8e60-546f315685d1 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:31.527630 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 599/1223] 10.222.0.83 () {54 vars in 921 bytes} [Wed Jul 27 20:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:25:31.544051 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3657623-645b-42bf-8ecc-b288001419c9 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:31.544592 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3657623-645b-42bf-8ecc-b288001419c9 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:31.544592 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3657623-645b-42bf-8ecc-b288001419c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:31.569572 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-b3657623-645b-42bf-8ecc-b288001419c9 None None] MFA Rules not processed for user `f68b37524d7245e4b606ad8dd15442ef`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:25:31.570782 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-b3657623-645b-42bf-8ecc-b288001419c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:25:31.579556 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 625/1224] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Jul 27 20:25:31 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:25:31.605255 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676bc2bb-e704-421f-8e60-546f315685d1 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:25:31.620273 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676bc2bb-e704-421f-8e60-546f315685d1 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:25:31.626794 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a476ccf-69f2-430f-a70d-3edfe9d5862a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:25:31.627441 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a476ccf-69f2-430f-a70d-3edfe9d5862a service nova] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:31.627705 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a476ccf-69f2-430f-a70d-3edfe9d5862a service nova] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:31.627971 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a476ccf-69f2-430f-a70d-3edfe9d5862a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:31.636647 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a476ccf-69f2-430f-a70d-3edfe9d5862a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:25:31.638276 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a476ccf-69f2-430f-a70d-3edfe9d5862a service nova] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:25:31.648359 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 600/1225] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:25:31 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 20:25:41.564079 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=12 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:41.644177 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=15 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:45.284367 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3657623-645b-42bf-8ecc-b288001419c9 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:25:45.293758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3657623-645b-42bf-8ecc-b288001419c9 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:25:45.297723 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb0cd3-e4af-46e3-99e0-2ae7e4e9d98c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:25:45.298230 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb0cd3-e4af-46e3-99e0-2ae7e4e9d98c service neutron] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:45.298405 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb0cd3-e4af-46e3-99e0-2ae7e4e9d98c service neutron] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:45.298683 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb0cd3-e4af-46e3-99e0-2ae7e4e9d98c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:45.309144 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb0cd3-e4af-46e3-99e0-2ae7e4e9d98c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:25:45.310597 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb0cd3-e4af-46e3-99e0-2ae7e4e9d98c service neutron] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:25:45.320537 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 626/1226] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:25:45 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:25:47.356220 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f552d9f-688a-468e-9d6a-f11344b57cdf None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:47.356820 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f552d9f-688a-468e-9d6a-f11344b57cdf None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:47.356820 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f552d9f-688a-468e-9d6a-f11344b57cdf None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:47.359050 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 601/1227] 10.222.0.83 () {54 vars in 921 bytes} [Wed Jul 27 20:25:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:25:47.364804 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc71842-826b-45b0-85e3-c7f455bcf202 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:47.365293 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc71842-826b-45b0-85e3-c7f455bcf202 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:47.365557 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc71842-826b-45b0-85e3-c7f455bcf202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:47.541162 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-7cc71842-826b-45b0-85e3-c7f455bcf202 None None] MFA Rules not processed for user `f68b37524d7245e4b606ad8dd15442ef`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:25:47.542398 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-7cc71842-826b-45b0-85e3-c7f455bcf202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:25:47.553279 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 627/1228] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Jul 27 20:25:47 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:25:47.573251 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f552d9f-688a-468e-9d6a-f11344b57cdf None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:25:47.589175 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f552d9f-688a-468e-9d6a-f11344b57cdf None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:25:47.594893 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49a27c-2fcd-472d-a31d-7500a705c6dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:25:47.595678 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49a27c-2fcd-472d-a31d-7500a705c6dc service nova] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:47.596032 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49a27c-2fcd-472d-a31d-7500a705c6dc service nova] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:47.596385 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49a27c-2fcd-472d-a31d-7500a705c6dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:47.608169 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49a27c-2fcd-472d-a31d-7500a705c6dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:25:47.611288 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49a27c-2fcd-472d-a31d-7500a705c6dc service nova] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:25:47.638138 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 602/1229] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:25:47 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:25:57.384087 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=9 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:57.619935 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=6 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:59.224197 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9293e-e7db-4c1e-9bd3-0d72f14729ff None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:59.224695 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9293e-e7db-4c1e-9bd3-0d72f14729ff None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:59.224803 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9293e-e7db-4c1e-9bd3-0d72f14729ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:59.243668 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-33a9293e-e7db-4c1e-9bd3-0d72f14729ff None None] MFA Rules not processed for user `a198f11ad00e442ab5705502607ef30e`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:25:59.244864 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-33a9293e-e7db-4c1e-9bd3-0d72f14729ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:25:59.252464 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 628/1230] 10.222.0.83 () {58 vars in 958 bytes} [Wed Jul 27 20:25:59 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:25:59.542349 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951e195-be6f-4388-96b2-94ae0db82257 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:59.542849 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951e195-be6f-4388-96b2-94ae0db82257 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:59.542954 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951e195-be6f-4388-96b2-94ae0db82257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:59.562228 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-6951e195-be6f-4388-96b2-94ae0db82257 None None] MFA Rules not processed for user `308f029a3e7b46fbaff75a01720c8986`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:25:59.564105 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-6951e195-be6f-4388-96b2-94ae0db82257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:25:59.570388 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 603/1231] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Jul 27 20:25:59 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:25:59.581437 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9293e-e7db-4c1e-9bd3-0d72f14729ff None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:25:59.590682 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9293e-e7db-4c1e-9bd3-0d72f14729ff None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:25:59.594702 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc882452-c2b7-45f2-92a2-7ca1614896ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:25:59.595345 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc882452-c2b7-45f2-92a2-7ca1614896ee service neutron] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:25:59.595622 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc882452-c2b7-45f2-92a2-7ca1614896ee service neutron] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:25:59.595891 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc882452-c2b7-45f2-92a2-7ca1614896ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:25:59.602760 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc882452-c2b7-45f2-92a2-7ca1614896ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:25:59.604227 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc882452-c2b7-45f2-92a2-7ca1614896ee service neutron] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:25:59.612411 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 629/1232] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:25:59 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:26:09.557577 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=3 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:09.608476 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=9 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:24.417495 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47320d-7fc1-41a8-9d17-a21f0d581a37 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:26:24.417941 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47320d-7fc1-41a8-9d17-a21f0d581a37 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:26:24.418018 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47320d-7fc1-41a8-9d17-a21f0d581a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:26:24.437015 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-de47320d-7fc1-41a8-9d17-a21f0d581a37 None None] MFA Rules not processed for user `a198f11ad00e442ab5705502607ef30e`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:26:24.438224 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-de47320d-7fc1-41a8-9d17-a21f0d581a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:26:24.445020 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 604/1233] 10.222.0.83 () {58 vars in 958 bytes} [Wed Jul 27 20:26:24 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:26:34.432266 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=3 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:40.005998 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ad470-f8db-41bd-b3aa-bb81d461e34e None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:26:40.006447 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ad470-f8db-41bd-b3aa-bb81d461e34e None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:26:40.006537 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ad470-f8db-41bd-b3aa-bb81d461e34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:26:40.025608 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-481ad470-f8db-41bd-b3aa-bb81d461e34e None None] MFA Rules not processed for user `a198f11ad00e442ab5705502607ef30e`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:26:40.026791 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-481ad470-f8db-41bd-b3aa-bb81d461e34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:26:40.033917 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 630/1234] 10.222.0.83 () {58 vars in 958 bytes} [Wed Jul 27 20:26:40 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:26:50.020764 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=3 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:27:41.866314 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d15e70-6754-4e38-8c84-d2320d160a52 None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:27:41.866809 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d15e70-6754-4e38-8c84-d2320d160a52 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:27:41.867083 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d15e70-6754-4e38-8c84-d2320d160a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:27:41.889517 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-25d15e70-6754-4e38-8c84-d2320d160a52 None None] MFA Rules not processed for user `a198f11ad00e442ab5705502607ef30e`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:27:41.890718 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-25d15e70-6754-4e38-8c84-d2320d160a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:27:41.897966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 605/1235] 10.222.0.83 () {58 vars in 958 bytes} [Wed Jul 27 20:27:41 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:27:51.884916 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=3 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:27:54.508361 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ad470-f8db-41bd-b3aa-bb81d461e34e None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:27:54.527226 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ad470-f8db-41bd-b3aa-bb81d461e34e None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:27:54.530700 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c927be4-05be-41d1-a92e-a204cab7a47e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:27:54.531338 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c927be4-05be-41d1-a92e-a204cab7a47e service neutron] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:27:54.531621 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c927be4-05be-41d1-a92e-a204cab7a47e service neutron] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:27:54.531893 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c927be4-05be-41d1-a92e-a204cab7a47e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:27:54.541248 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c927be4-05be-41d1-a92e-a204cab7a47e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:27:54.542674 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c927be4-05be-41d1-a92e-a204cab7a47e service neutron] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:27:54.551808 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 631/1236] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:27:54 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 20:28:04.547789 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=10 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:29:00.583606 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d15e70-6754-4e38-8c84-d2320d160a52 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:29:00.604674 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d15e70-6754-4e38-8c84-d2320d160a52 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:29:00.610140 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab7451-845b-444d-8d74-aa8fbffa85f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733839729aa249e0823f24a8e8fb3ffe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:29:00.610748 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab7451-845b-444d-8d74-aa8fbffa85f4 service placement] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:29:00.611031 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab7451-845b-444d-8d74-aa8fbffa85f4 service placement] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:29:00.611340 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab7451-845b-444d-8d74-aa8fbffa85f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:29:00.619847 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab7451-845b-444d-8d74-aa8fbffa85f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:29:00.621431 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab7451-845b-444d-8d74-aa8fbffa85f4 service placement] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:29:00.631140 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 606/1237] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:29:00 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:29:10.627147 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=10 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:01.284145 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c927be4-05be-41d1-a92e-a204cab7a47e service neutron] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:30:01.304967 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c927be4-05be-41d1-a92e-a204cab7a47e service neutron] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:30:01.309935 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5119c41-5f28-4b89-a3e1-a6ead1f4895f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:30:01.310544 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5119c41-5f28-4b89-a3e1-a6ead1f4895f service nova] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:30:01.310831 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5119c41-5f28-4b89-a3e1-a6ead1f4895f service nova] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:30:01.311165 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5119c41-5f28-4b89-a3e1-a6ead1f4895f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:30:01.319825 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5119c41-5f28-4b89-a3e1-a6ead1f4895f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:30:01.321410 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5119c41-5f28-4b89-a3e1-a6ead1f4895f service nova] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:30:01.330159 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 632/1238] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:30:01 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:30:06.018192 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466b1dd-a385-41f2-b932-5822b68fbaed None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:30:06.018654 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466b1dd-a385-41f2-b932-5822b68fbaed None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:30:06.018769 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466b1dd-a385-41f2-b932-5822b68fbaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:30:06.036932 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-9466b1dd-a385-41f2-b932-5822b68fbaed None None] MFA Rules not processed for user `a198f11ad00e442ab5705502607ef30e`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:30:06.038116 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-9466b1dd-a385-41f2-b932-5822b68fbaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:30:06.044947 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 607/1239] 10.222.0.83 () {58 vars in 958 bytes} [Wed Jul 27 20:30:06 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:30:10.273931 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5119c41-5f28-4b89-a3e1-a6ead1f4895f service nova] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:30:10.282895 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5119c41-5f28-4b89-a3e1-a6ead1f4895f service nova] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:30:10.286429 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110f73a-f520-4c3f-b2ac-1b504e9e9e80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:30:10.287027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110f73a-f520-4c3f-b2ac-1b504e9e9e80 service neutron] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:30:10.287340 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110f73a-f520-4c3f-b2ac-1b504e9e9e80 service neutron] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:30:10.287614 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110f73a-f520-4c3f-b2ac-1b504e9e9e80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:30:10.296771 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110f73a-f520-4c3f-b2ac-1b504e9e9e80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:30:10.298225 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110f73a-f520-4c3f-b2ac-1b504e9e9e80 service neutron] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:30:10.309020 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 633/1240] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:30:10 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:30:11.482853 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466b1dd-a385-41f2-b932-5822b68fbaed None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:30:11.492343 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466b1dd-a385-41f2-b932-5822b68fbaed None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:30:11.495896 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b50e8-d12f-4c50-bbe2-16aa414cc01c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:30:11.496615 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b50e8-d12f-4c50-bbe2-16aa414cc01c service neutron] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:30:11.496781 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b50e8-d12f-4c50-bbe2-16aa414cc01c service neutron] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:30:11.497054 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b50e8-d12f-4c50-bbe2-16aa414cc01c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:30:11.506167 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b50e8-d12f-4c50-bbe2-16aa414cc01c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:30:11.508167 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b50e8-d12f-4c50-bbe2-16aa414cc01c service neutron] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:30:11.518079 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 608/1241] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:30:11 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:30:20.304072 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=16 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:20.657331 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110f73a-f520-4c3f-b2ac-1b504e9e9e80 service neutron] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:30:20.670581 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110f73a-f520-4c3f-b2ac-1b504e9e9e80 service neutron] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:30:20.675863 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91702f-2d04-43a7-8e3a-522585c50382 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:30:20.676836 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91702f-2d04-43a7-8e3a-522585c50382 service nova] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:30:20.676944 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91702f-2d04-43a7-8e3a-522585c50382 service nova] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:30:20.677135 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91702f-2d04-43a7-8e3a-522585c50382 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:30:20.686407 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e91702f-2d04-43a7-8e3a-522585c50382 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:30:20.688026 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e91702f-2d04-43a7-8e3a-522585c50382 service nova] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:30:20.697984 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 634/1242] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:30:20 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:30:21.513799 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=9 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:22.762510 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b50e8-d12f-4c50-bbe2-16aa414cc01c service neutron] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:30:22.771653 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b50e8-d12f-4c50-bbe2-16aa414cc01c service neutron] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:30:22.775691 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695f7d7-1b62-4d6d-9c6f-8f19fb6095fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:30:22.776859 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695f7d7-1b62-4d6d-9c6f-8f19fb6095fd service neutron] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:30:22.777305 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695f7d7-1b62-4d6d-9c6f-8f19fb6095fd service neutron] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:30:22.777573 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695f7d7-1b62-4d6d-9c6f-8f19fb6095fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:30:22.785277 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695f7d7-1b62-4d6d-9c6f-8f19fb6095fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:30:22.786701 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695f7d7-1b62-4d6d-9c6f-8f19fb6095fd service neutron] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:30:22.796071 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 609/1243] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:30:22 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:30:27.846973 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91702f-2d04-43a7-8e3a-522585c50382 service nova] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:30:27.857836 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91702f-2d04-43a7-8e3a-522585c50382 service nova] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:30:27.863095 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3e81f-e01a-49d1-b484-59814df7a796 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:30:27.863874 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3e81f-e01a-49d1-b484-59814df7a796 service nova] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:30:27.863986 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3e81f-e01a-49d1-b484-59814df7a796 service nova] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:30:27.864261 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3e81f-e01a-49d1-b484-59814df7a796 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:30:27.874063 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3e81f-e01a-49d1-b484-59814df7a796 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:30:27.876220 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3e81f-e01a-49d1-b484-59814df7a796 service nova] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:30:27.888126 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 635/1244] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:30:27 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:30:32.791711 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=6 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:36.393104 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d458ed2-0e80-482a-8863-ce1fb438acfd None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:30:36.393716 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d458ed2-0e80-482a-8863-ce1fb438acfd None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:30:36.393716 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d458ed2-0e80-482a-8863-ce1fb438acfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:30:36.413530 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-4d458ed2-0e80-482a-8863-ce1fb438acfd None None] MFA Rules not processed for user `558a217004b94021b2022b258b0b023a`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:30:36.415049 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-4d458ed2-0e80-482a-8863-ce1fb438acfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:30:36.422121 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 610/1245] 10.222.0.83 () {58 vars in 958 bytes} [Wed Jul 27 20:30:36 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 20:30:36.681117 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3e81f-e01a-49d1-b484-59814df7a796 service nova] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:30:36.690553 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3e81f-e01a-49d1-b484-59814df7a796 service nova] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:30:36.694353 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8275126-151d-4e5b-94dc-0bd67297ca23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:30:36.695056 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8275126-151d-4e5b-94dc-0bd67297ca23 service neutron] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:30:36.695370 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8275126-151d-4e5b-94dc-0bd67297ca23 service neutron] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:30:36.695643 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8275126-151d-4e5b-94dc-0bd67297ca23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:30:36.702954 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8275126-151d-4e5b-94dc-0bd67297ca23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:30:36.704410 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8275126-151d-4e5b-94dc-0bd67297ca23 service neutron] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:30:36.712807 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 636/1246] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:30:36 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:30:37.055254 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d458ed2-0e80-482a-8863-ce1fb438acfd None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:30:37.070922 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d458ed2-0e80-482a-8863-ce1fb438acfd None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:30:37.078374 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a9e5a-54c5-4f97-a8a6-c15cdb492cb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733839729aa249e0823f24a8e8fb3ffe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:30:37.079024 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a9e5a-54c5-4f97-a8a6-c15cdb492cb6 service placement] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:30:37.079353 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a9e5a-54c5-4f97-a8a6-c15cdb492cb6 service placement] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:30:37.079635 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a9e5a-54c5-4f97-a8a6-c15cdb492cb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:30:37.090433 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a9e5a-54c5-4f97-a8a6-c15cdb492cb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:30:37.092091 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a9e5a-54c5-4f97-a8a6-c15cdb492cb6 service placement] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:30:37.103831 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 611/1247] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:30:37 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:30:46.708878 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=18 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:47.099346 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=9 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:54.912277 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8275126-151d-4e5b-94dc-0bd67297ca23 service neutron] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:30:54.924367 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8275126-151d-4e5b-94dc-0bd67297ca23 service neutron] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:30:54.929260 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf71e1f-4751-4de3-bad7-d3815ef455ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:30:54.929885 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf71e1f-4751-4de3-bad7-d3815ef455ed service nova] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:30:54.930261 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf71e1f-4751-4de3-bad7-d3815ef455ed service nova] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:30:54.930523 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf71e1f-4751-4de3-bad7-d3815ef455ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:30:54.939460 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf71e1f-4751-4de3-bad7-d3815ef455ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:30:54.941063 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf71e1f-4751-4de3-bad7-d3815ef455ed service nova] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:30:54.951252 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 637/1248] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:30:54 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:31:02.951316 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a9e5a-54c5-4f97-a8a6-c15cdb492cb6 service placement] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:31:02.961495 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a9e5a-54c5-4f97-a8a6-c15cdb492cb6 service placement] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:31:02.966083 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d97823-c86c-4610-a4d4-53b8a1e0afcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:31:02.966685 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d97823-c86c-4610-a4d4-53b8a1e0afcc service neutron] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:31:02.966966 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d97823-c86c-4610-a4d4-53b8a1e0afcc service neutron] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:31:02.967264 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d97823-c86c-4610-a4d4-53b8a1e0afcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:31:02.978134 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d97823-c86c-4610-a4d4-53b8a1e0afcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:31:02.979631 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d97823-c86c-4610-a4d4-53b8a1e0afcc service neutron] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:31:02.989327 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 612/1249] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:31:02 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:31:04.629180 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf71e1f-4751-4de3-bad7-d3815ef455ed service nova] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:31:04.642780 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf71e1f-4751-4de3-bad7-d3815ef455ed service nova] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:31:04.651277 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275cf5a-d459-4554-95ac-9960ce82bf83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68b37524d7245e4b606ad8dd15442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:31:04.651990 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275cf5a-d459-4554-95ac-9960ce82bf83 service nova] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:31:04.652410 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275cf5a-d459-4554-95ac-9960ce82bf83 service nova] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:31:04.652694 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275cf5a-d459-4554-95ac-9960ce82bf83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:31:04.663090 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275cf5a-d459-4554-95ac-9960ce82bf83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:31:04.664909 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275cf5a-d459-4554-95ac-9960ce82bf83 service nova] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:31:04.677488 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 638/1250] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:31:04 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:31:12.985135 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=6 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:31:14.672273 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=12 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:32:02.708512 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20dda2-09e7-4be8-bc57-a4f2da48bbfb None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:32:02.709027 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20dda2-09e7-4be8-bc57-a4f2da48bbfb None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:32:02.709124 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20dda2-09e7-4be8-bc57-a4f2da48bbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:32:02.727754 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-ef20dda2-09e7-4be8-bc57-a4f2da48bbfb None None] MFA Rules not processed for user `a198f11ad00e442ab5705502607ef30e`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:32:02.728925 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-ef20dda2-09e7-4be8-bc57-a4f2da48bbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:32:02.735804 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 613/1251] 10.222.0.83 () {58 vars in 958 bytes} [Wed Jul 27 20:32:02 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:32:03.046587 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275cf5a-d459-4554-95ac-9960ce82bf83 service nova] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:32:03.055535 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275cf5a-d459-4554-95ac-9960ce82bf83 service nova] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:32:03.059579 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebac17-2b35-47f6-bb73-d2e2beadc60c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:32:03.060176 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebac17-2b35-47f6-bb73-d2e2beadc60c service neutron] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:32:03.060451 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebac17-2b35-47f6-bb73-d2e2beadc60c service neutron] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:32:03.060721 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebac17-2b35-47f6-bb73-d2e2beadc60c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:32:03.067554 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebac17-2b35-47f6-bb73-d2e2beadc60c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:32:03.068984 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebac17-2b35-47f6-bb73-d2e2beadc60c service neutron] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:32:03.077092 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 639/1252] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:32:03 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:32:12.723208 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=3 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:32:13.073229 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=6 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:33:38.279137 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20dda2-09e7-4be8-bc57-a4f2da48bbfb None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:33:38.299868 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20dda2-09e7-4be8-bc57-a4f2da48bbfb None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:33:38.303451 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6de15-c0f4-4c91-9dde-5bd18c873d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:33:38.304064 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6de15-c0f4-4c91-9dde-5bd18c873d27 service neutron] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:33:38.304340 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6de15-c0f4-4c91-9dde-5bd18c873d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:33:38.304609 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6de15-c0f4-4c91-9dde-5bd18c873d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:33:38.394612 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6de15-c0f4-4c91-9dde-5bd18c873d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:33:38.396010 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6de15-c0f4-4c91-9dde-5bd18c873d27 service neutron] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:33:38.415018 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 614/1253] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:33:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:33:41.623730 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdba35-8619-4a27-8e14-2b7c87c0f2ef None None] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:33:41.624267 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdba35-8619-4a27-8e14-2b7c87c0f2ef None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:33:41.624267 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdba35-8619-4a27-8e14-2b7c87c0f2ef None None] PATH_INFO: `/` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:33:41.625619 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 640/1254] 10.222.0.83 () {54 vars in 921 bytes} [Wed Jul 27 20:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:33:41.637457 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415cb96-7ca3-4528-9c86-327692b2694d None None] REQUEST_METHOD: `POST` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:33:41.638563 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415cb96-7ca3-4528-9c86-327692b2694d None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:33:41.638951 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415cb96-7ca3-4528-9c86-327692b2694d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:33:41.730634 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.auth.core [None req-2415cb96-7ca3-4528-9c86-327692b2694d None None] MFA Rules not processed for user `733839729aa249e0823f24a8e8fb3ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=87127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:33:41.731818 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-2415cb96-7ca3-4528-9c86-327692b2694d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:33:41.750769 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 615/1255] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Jul 27 20:33:41 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:33:41.769506 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdba35-8619-4a27-8e14-2b7c87c0f2ef None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:33:41.782726 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdba35-8619-4a27-8e14-2b7c87c0f2ef None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:33:41.787754 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac89b3-4ba7-42ee-ac70-39ba46cb2421 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733839729aa249e0823f24a8e8fb3ffe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:33:41.788378 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac89b3-4ba7-42ee-ac70-39ba46cb2421 service placement] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:33:41.788656 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac89b3-4ba7-42ee-ac70-39ba46cb2421 service placement] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:33:41.788930 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac89b3-4ba7-42ee-ac70-39ba46cb2421 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:33:41.799206 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac89b3-4ba7-42ee-ac70-39ba46cb2421 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:33:41.800809 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac89b3-4ba7-42ee-ac70-39ba46cb2421 service placement] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:33:41.812275 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 641/1256] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:33:41 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:33:45.009391 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c387e48-2561-464a-8310-1af9efd274c3 None None] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:33:45.010508 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c387e48-2561-464a-8310-1af9efd274c3 None None] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:33:45.010796 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c387e48-2561-464a-8310-1af9efd274c3 None None] PATH_INFO: `/` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:33:45.012239 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 616/1257] 10.222.0.83 () {54 vars in 921 bytes} [Wed Jul 27 20:33:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 20:33:45.048097 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77465c8a-25ac-4133-a7e7-60494ea77491 None None] REQUEST_METHOD: `POST` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:33:45.049215 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77465c8a-25ac-4133-a7e7-60494ea77491 None None] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:33:45.049568 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77465c8a-25ac-4133-a7e7-60494ea77491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:33:45.076828 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.auth.core [None req-77465c8a-25ac-4133-a7e7-60494ea77491 None None] MFA Rules not processed for user `733839729aa249e0823f24a8e8fb3ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=87126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 20:33:45.077875 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-77465c8a-25ac-4133-a7e7-60494ea77491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:33:45.080047 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c387e48-2561-464a-8310-1af9efd274c3 None None] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:33:45.090646 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 642/1258] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Jul 27 20:33:45 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 20:33:45.096275 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c387e48-2561-464a-8310-1af9efd274c3 None None] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:33:45.101250 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de34b0a-1ccf-43c6-ad3b-e2a978fb778b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:33:45.102045 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de34b0a-1ccf-43c6-ad3b-e2a978fb778b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:33:45.102390 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de34b0a-1ccf-43c6-ad3b-e2a978fb778b admin admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:33:45.102825 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de34b0a-1ccf-43c6-ad3b-e2a978fb778b admin admin] PATH_INFO: `/v3/users/558a217004b94021b2022b258b0b023a` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:33:45.104212 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de34b0a-1ccf-43c6-ad3b-e2a978fb778b admin admin] RBAC: Authorizing `identity:delete_user(user_id=558a217004b94021b2022b258b0b023a)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:33:45.104340 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77465c8a-25ac-4133-a7e7-60494ea77491 None None] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:33:45.105422 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: WARNING py.warnings [None req-8de34b0a-1ccf-43c6-ad3b-e2a978fb778b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:33:45.105422 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: warnings.warn(msg) Jul 27 20:33:45.105422 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: Jul 27 20:33:45.107347 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de34b0a-1ccf-43c6-ad3b-e2a978fb778b admin admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:33:45.115044 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77465c8a-25ac-4133-a7e7-60494ea77491 None None] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:33:45.120544 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222062b-1739-4d26-9d91-9dea8b3a9a49 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733839729aa249e0823f24a8e8fb3ffe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:33:45.121287 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222062b-1739-4d26-9d91-9dea8b3a9a49 service placement] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:33:45.121758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222062b-1739-4d26-9d91-9dea8b3a9a49 service placement] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:33:45.122037 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222062b-1739-4d26-9d91-9dea8b3a9a49 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:33:45.130865 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222062b-1739-4d26-9d91-9dea8b3a9a49 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:33:45.132508 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222062b-1739-4d26-9d91-9dea8b3a9a49 service placement] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:33:45.142565 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 643/1259] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:33:45 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:33:45.161725 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:33:45.176190 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [None req-8de34b0a-1ccf-43c6-ad3b-e2a978fb778b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '558a217004b94021b2022b258b0b023a'} {{(pid=87127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:33:45.183562 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [None req-8de34b0a-1ccf-43c6-ad3b-e2a978fb778b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '558a217004b94021b2022b258b0b023a'} {{(pid=87127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:33:45.201887 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [None req-8de34b0a-1ccf-43c6-ad3b-e2a978fb778b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '558a217004b94021b2022b258b0b023a'} {{(pid=87127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:33:45.202580 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [None req-8de34b0a-1ccf-43c6-ad3b-e2a978fb778b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '558a217004b94021b2022b258b0b023a'} {{(pid=87127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:33:45.203233 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [None req-8de34b0a-1ccf-43c6-ad3b-e2a978fb778b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '558a217004b94021b2022b258b0b023a'} {{(pid=87127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:33:45.218756 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 617/1260] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Jul 27 20:33:45 2022] DELETE /identity/v3/users/558a217004b94021b2022b258b0b023a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 20:33:45.407301 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222062b-1739-4d26-9d91-9dea8b3a9a49 service placement] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:33:45.420220 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222062b-1739-4d26-9d91-9dea8b3a9a49 service placement] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:33:45.478622 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbfb7b-6cba-45b6-a65a-3cac8439b269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:33:45.479307 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbfb7b-6cba-45b6-a65a-3cac8439b269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:33:45.479593 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbfb7b-6cba-45b6-a65a-3cac8439b269 admin admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:33:45.479863 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbfb7b-6cba-45b6-a65a-3cac8439b269 admin admin] PATH_INFO: `/v3/projects/3c50ef6e43904fdc9a5a8666778f69f3` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:33:45.481017 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccbfb7b-6cba-45b6-a65a-3cac8439b269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c50ef6e43904fdc9a5a8666778f69f3)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:33:45.482040 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: WARNING py.warnings [None req-8ccbfb7b-6cba-45b6-a65a-3cac8439b269 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:33:45.482040 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: warnings.warn(msg) Jul 27 20:33:45.482040 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: Jul 27 20:33:45.483285 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccbfb7b-6cba-45b6-a65a-3cac8439b269 admin admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:33:45.537000 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-8ccbfb7b-6cba-45b6-a65a-3cac8439b269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c50ef6e43904fdc9a5a8666778f69f3', 'request_id': 'req-8ccbfb7b-6cba-45b6-a65a-3cac8439b269'} {{(pid=87126) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:33:45.549549 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-8ccbfb7b-6cba-45b6-a65a-3cac8439b269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c50ef6e43904fdc9a5a8666778f69f3', 'request_id': 'req-8ccbfb7b-6cba-45b6-a65a-3cac8439b269'} {{(pid=87126) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:33:45.557050 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-8ccbfb7b-6cba-45b6-a65a-3cac8439b269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c50ef6e43904fdc9a5a8666778f69f3', 'request_id': 'req-8ccbfb7b-6cba-45b6-a65a-3cac8439b269'} {{(pid=87126) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:33:45.591027 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-8ccbfb7b-6cba-45b6-a65a-3cac8439b269 admin admin] The token cache is being invalidate because project 3c50ef6e43904fdc9a5a8666778f69f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87126) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 20:33:45.591277 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-8ccbfb7b-6cba-45b6-a65a-3cac8439b269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87126) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:33:45.591933 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-8ccbfb7b-6cba-45b6-a65a-3cac8439b269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87126) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:33:45.593848 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 644/1261] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Jul 27 20:33:45 2022] DELETE /identity/v3/projects/3c50ef6e43904fdc9a5a8666778f69f3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:33:45.597960 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de34b0a-1ccf-43c6-ad3b-e2a978fb778b admin admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:33:45.599418 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-8de34b0a-1ccf-43c6-ad3b-e2a978fb778b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:33:45.612549 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de34b0a-1ccf-43c6-ad3b-e2a978fb778b admin admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:33:45.669030 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3861a-3b99-4f7d-beac-eeb7fe7ac19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:33:45.669669 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3861a-3b99-4f7d-beac-eeb7fe7ac19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:33:45.669950 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3861a-3b99-4f7d-beac-eeb7fe7ac19f admin admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:33:45.670226 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3861a-3b99-4f7d-beac-eeb7fe7ac19f admin admin] PATH_INFO: `/v3/users/adc782c099ee4b74b9541836a620b7ff` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:33:45.671400 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3861a-3b99-4f7d-beac-eeb7fe7ac19f admin admin] RBAC: Authorizing `identity:delete_user(user_id=adc782c099ee4b74b9541836a620b7ff)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:33:45.673327 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3861a-3b99-4f7d-beac-eeb7fe7ac19f admin admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:33:45.718130 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [None req-aee3861a-3b99-4f7d-beac-eeb7fe7ac19f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adc782c099ee4b74b9541836a620b7ff'} {{(pid=87127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:33:45.724506 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [None req-aee3861a-3b99-4f7d-beac-eeb7fe7ac19f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adc782c099ee4b74b9541836a620b7ff'} {{(pid=87127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:33:45.736358 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [None req-aee3861a-3b99-4f7d-beac-eeb7fe7ac19f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adc782c099ee4b74b9541836a620b7ff'} {{(pid=87127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:33:45.736992 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [None req-aee3861a-3b99-4f7d-beac-eeb7fe7ac19f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adc782c099ee4b74b9541836a620b7ff'} {{(pid=87127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:33:45.737593 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [None req-aee3861a-3b99-4f7d-beac-eeb7fe7ac19f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adc782c099ee4b74b9541836a620b7ff'} {{(pid=87127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:33:45.750202 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 618/1262] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Jul 27 20:33:45 2022] DELETE /identity/v3/users/adc782c099ee4b74b9541836a620b7ff => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:33:45.920128 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbfb7b-6cba-45b6-a65a-3cac8439b269 admin admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:33:45.921558 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-8ccbfb7b-6cba-45b6-a65a-3cac8439b269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:33:45.935156 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbfb7b-6cba-45b6-a65a-3cac8439b269 admin admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:33:45.979902 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:33:45.994513 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d9c17-bc95-4df7-b651-cb8ca1f9a976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:33:45.995194 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d9c17-bc95-4df7-b651-cb8ca1f9a976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:33:45.995477 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d9c17-bc95-4df7-b651-cb8ca1f9a976 admin admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:33:45.995757 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d9c17-bc95-4df7-b651-cb8ca1f9a976 admin admin] PATH_INFO: `/v3/projects/2578d041e1084901a2b7f0fe79d00116` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:33:45.997471 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d9c17-bc95-4df7-b651-cb8ca1f9a976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2578d041e1084901a2b7f0fe79d00116)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:33:45.999450 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d9c17-bc95-4df7-b651-cb8ca1f9a976 admin admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:33:46.045931 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-a88d9c17-bc95-4df7-b651-cb8ca1f9a976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2578d041e1084901a2b7f0fe79d00116', 'request_id': 'req-a88d9c17-bc95-4df7-b651-cb8ca1f9a976'} {{(pid=87126) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:33:46.051915 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-a88d9c17-bc95-4df7-b651-cb8ca1f9a976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2578d041e1084901a2b7f0fe79d00116', 'request_id': 'req-a88d9c17-bc95-4df7-b651-cb8ca1f9a976'} {{(pid=87126) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:33:46.059994 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-a88d9c17-bc95-4df7-b651-cb8ca1f9a976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2578d041e1084901a2b7f0fe79d00116', 'request_id': 'req-a88d9c17-bc95-4df7-b651-cb8ca1f9a976'} {{(pid=87126) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:33:46.070207 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-a88d9c17-bc95-4df7-b651-cb8ca1f9a976 admin admin] The token cache is being invalidate because project 2578d041e1084901a2b7f0fe79d00116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87126) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 20:33:46.070496 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-a88d9c17-bc95-4df7-b651-cb8ca1f9a976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87126) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:33:46.071157 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-a88d9c17-bc95-4df7-b651-cb8ca1f9a976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87126) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:33:46.072666 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 645/1263] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Jul 27 20:33:45 2022] DELETE /identity/v3/projects/2578d041e1084901a2b7f0fe79d00116 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:33:55.746259 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=69,keystone:DELETE=15,keystone:INSERT=2 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:33:56.067384 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=30,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:34:00.836870 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3861a-3b99-4f7d-beac-eeb7fe7ac19f admin admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:34:00.838215 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-aee3861a-3b99-4f7d-beac-eeb7fe7ac19f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:34:00.908367 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3861a-3b99-4f7d-beac-eeb7fe7ac19f admin admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:34:00.981756 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e671a-09af-4dcb-a06e-5ca7e0927f4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733839729aa249e0823f24a8e8fb3ffe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:34:00.982392 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e671a-09af-4dcb-a06e-5ca7e0927f4b service placement] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:34:00.982674 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e671a-09af-4dcb-a06e-5ca7e0927f4b service placement] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:34:00.982946 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e671a-09af-4dcb-a06e-5ca7e0927f4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:34:00.985344 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-3d9e671a-09af-4dcb-a06e-5ca7e0927f4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:34:01.003259 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e671a-09af-4dcb-a06e-5ca7e0927f4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:34:01.004840 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e671a-09af-4dcb-a06e-5ca7e0927f4b service placement] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:34:01.014997 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 619/1264] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:34:00 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:34:11.010486 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=58 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:34:41.154996 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d9c17-bc95-4df7-b651-cb8ca1f9a976 admin admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:34:41.161689 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-a88d9c17-bc95-4df7-b651-cb8ca1f9a976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:34:41.213972 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d9c17-bc95-4df7-b651-cb8ca1f9a976 admin admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:34:41.217599 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4645244-b2f8-4144-bfb2-28e83600cab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '308f029a3e7b46fbaff75a01720c8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:34:41.218212 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4645244-b2f8-4144-bfb2-28e83600cab1 service neutron] REQUEST_METHOD: `GET` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:34:41.218491 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4645244-b2f8-4144-bfb2-28e83600cab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:34:41.218767 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4645244-b2f8-4144-bfb2-28e83600cab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:34:41.220550 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-b4645244-b2f8-4144-bfb2-28e83600cab1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:34:41.284449 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4645244-b2f8-4144-bfb2-28e83600cab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:34:41.286417 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4645244-b2f8-4144-bfb2-28e83600cab1 service neutron] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:34:41.295758 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 646/1265] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:34:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 20:34:47.549245 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e671a-09af-4dcb-a06e-5ca7e0927f4b service placement] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:34:47.550943 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-3d9e671a-09af-4dcb-a06e-5ca7e0927f4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:34:47.564470 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e671a-09af-4dcb-a06e-5ca7e0927f4b service placement] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:34:47.569041 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f4a76-2b2e-4e66-a1a5-4ccca6c98665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:34:47.569684 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f4a76-2b2e-4e66-a1a5-4ccca6c98665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:34:47.569969 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f4a76-2b2e-4e66-a1a5-4ccca6c98665 admin admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:34:47.570246 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f4a76-2b2e-4e66-a1a5-4ccca6c98665 admin admin] PATH_INFO: `/v3/users/a198f11ad00e442ab5705502607ef30e` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:34:47.584419 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f4a76-2b2e-4e66-a1a5-4ccca6c98665 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a198f11ad00e442ab5705502607ef30e)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:34:47.586384 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f4a76-2b2e-4e66-a1a5-4ccca6c98665 admin admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:34:47.632768 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [None req-ef6f4a76-2b2e-4e66-a1a5-4ccca6c98665 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a198f11ad00e442ab5705502607ef30e'} {{(pid=87127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:34:47.640069 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [None req-ef6f4a76-2b2e-4e66-a1a5-4ccca6c98665 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a198f11ad00e442ab5705502607ef30e'} {{(pid=87127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:34:47.652344 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [None req-ef6f4a76-2b2e-4e66-a1a5-4ccca6c98665 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a198f11ad00e442ab5705502607ef30e'} {{(pid=87127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:34:47.652986 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [None req-ef6f4a76-2b2e-4e66-a1a5-4ccca6c98665 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a198f11ad00e442ab5705502607ef30e'} {{(pid=87127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:34:47.653633 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [None req-ef6f4a76-2b2e-4e66-a1a5-4ccca6c98665 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a198f11ad00e442ab5705502607ef30e'} {{(pid=87127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:34:47.666214 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 620/1266] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Jul 27 20:34:47 2022] DELETE /identity/v3/users/a198f11ad00e442ab5705502607ef30e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:34:47.850511 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4645244-b2f8-4144-bfb2-28e83600cab1 service neutron] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:34:47.865846 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4645244-b2f8-4144-bfb2-28e83600cab1 service neutron] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:34:47.929026 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca1b1b-ff80-420b-a0dd-79b7e2e2e572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:34:47.929611 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca1b1b-ff80-420b-a0dd-79b7e2e2e572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:34:47.929889 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca1b1b-ff80-420b-a0dd-79b7e2e2e572 admin admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:34:47.930160 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca1b1b-ff80-420b-a0dd-79b7e2e2e572 admin admin] PATH_INFO: `/v3/projects/13f7ef2b0f4948ab8659329446ce6fee` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:34:47.940261 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca1b1b-ff80-420b-a0dd-79b7e2e2e572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13f7ef2b0f4948ab8659329446ce6fee)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:34:47.942228 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca1b1b-ff80-420b-a0dd-79b7e2e2e572 admin admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:34:47.984594 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:34:47.988509 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-c0ca1b1b-ff80-420b-a0dd-79b7e2e2e572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13f7ef2b0f4948ab8659329446ce6fee', 'request_id': 'req-c0ca1b1b-ff80-420b-a0dd-79b7e2e2e572'} {{(pid=87126) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:34:47.995052 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-c0ca1b1b-ff80-420b-a0dd-79b7e2e2e572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13f7ef2b0f4948ab8659329446ce6fee', 'request_id': 'req-c0ca1b1b-ff80-420b-a0dd-79b7e2e2e572'} {{(pid=87126) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:34:48.002684 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-c0ca1b1b-ff80-420b-a0dd-79b7e2e2e572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13f7ef2b0f4948ab8659329446ce6fee', 'request_id': 'req-c0ca1b1b-ff80-420b-a0dd-79b7e2e2e572'} {{(pid=87126) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:34:48.013276 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-c0ca1b1b-ff80-420b-a0dd-79b7e2e2e572 admin admin] The token cache is being invalidate because project 13f7ef2b0f4948ab8659329446ce6fee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87126) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 20:34:48.013562 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-c0ca1b1b-ff80-420b-a0dd-79b7e2e2e572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87126) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:34:48.014251 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-c0ca1b1b-ff80-420b-a0dd-79b7e2e2e572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87126) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:34:48.015894 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 647/1267] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Jul 27 20:34:47 2022] DELETE /identity/v3/projects/13f7ef2b0f4948ab8659329446ce6fee => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:34:48.020011 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f4a76-2b2e-4e66-a1a5-4ccca6c98665 admin admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:34:48.022107 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-ef6f4a76-2b2e-4e66-a1a5-4ccca6c98665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:34:48.036039 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f4a76-2b2e-4e66-a1a5-4ccca6c98665 admin admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:34:48.091021 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd7262-970c-48d1-84cd-9401d5e15f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:34:48.091681 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd7262-970c-48d1-84cd-9401d5e15f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:34:48.091963 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd7262-970c-48d1-84cd-9401d5e15f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:34:48.092237 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd7262-970c-48d1-84cd-9401d5e15f79 admin admin] PATH_INFO: `/v3/users/1d64eedb78304e639f8a449e3de7bf5e` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:34:48.093386 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd7262-970c-48d1-84cd-9401d5e15f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d64eedb78304e639f8a449e3de7bf5e)` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:34:48.095347 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd7262-970c-48d1-84cd-9401d5e15f79 admin admin] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:34:48.142069 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [None req-b4cd7262-970c-48d1-84cd-9401d5e15f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d64eedb78304e639f8a449e3de7bf5e'} {{(pid=87127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:34:48.149787 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [None req-b4cd7262-970c-48d1-84cd-9401d5e15f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d64eedb78304e639f8a449e3de7bf5e'} {{(pid=87127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:34:48.156791 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:34:48.163191 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [None req-b4cd7262-970c-48d1-84cd-9401d5e15f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d64eedb78304e639f8a449e3de7bf5e'} {{(pid=87127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:34:48.164241 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [None req-b4cd7262-970c-48d1-84cd-9401d5e15f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d64eedb78304e639f8a449e3de7bf5e'} {{(pid=87127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:34:48.165129 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.notifications [None req-b4cd7262-970c-48d1-84cd-9401d5e15f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d64eedb78304e639f8a449e3de7bf5e'} {{(pid=87127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:34:48.180583 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 621/1268] 10.222.0.83 () {58 vars in 1224 bytes} [Wed Jul 27 20:34:48 2022] DELETE /identity/v3/users/1d64eedb78304e639f8a449e3de7bf5e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 20:34:48.356250 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca1b1b-ff80-420b-a0dd-79b7e2e2e572 admin admin] Authenticating user token {{(pid=87126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:34:48.357712 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.fernet_utils [None req-c0ca1b1b-ff80-420b-a0dd-79b7e2e2e572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:34:48.371443 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca1b1b-ff80-420b-a0dd-79b7e2e2e572 admin admin] Validating token access rules against request {{(pid=87126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:34:48.427899 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782aadb-39dc-4e62-99b9-80d357c3fd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c55d2b6170e4e2782d526caffb1c6c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85a972f1c766490294ece49f734d7df0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:34:48.428539 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782aadb-39dc-4e62-99b9-80d357c3fd9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:34:48.428817 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782aadb-39dc-4e62-99b9-80d357c3fd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:34:48.429085 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782aadb-39dc-4e62-99b9-80d357c3fd9d admin admin] PATH_INFO: `/v3/projects/a34478698f2744b49e3999d7661b51b5` {{(pid=87126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:34:48.430226 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782aadb-39dc-4e62-99b9-80d357c3fd9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a34478698f2744b49e3999d7661b51b5)` {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:34:48.432271 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782aadb-39dc-4e62-99b9-80d357c3fd9d admin admin] RBAC: Authorization granted {{(pid=87126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:34:48.476610 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-1782aadb-39dc-4e62-99b9-80d357c3fd9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a34478698f2744b49e3999d7661b51b5', 'request_id': 'req-1782aadb-39dc-4e62-99b9-80d357c3fd9d'} {{(pid=87126) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:34:48.482438 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-1782aadb-39dc-4e62-99b9-80d357c3fd9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a34478698f2744b49e3999d7661b51b5', 'request_id': 'req-1782aadb-39dc-4e62-99b9-80d357c3fd9d'} {{(pid=87126) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:34:48.489914 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-1782aadb-39dc-4e62-99b9-80d357c3fd9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a34478698f2744b49e3999d7661b51b5', 'request_id': 'req-1782aadb-39dc-4e62-99b9-80d357c3fd9d'} {{(pid=87126) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:34:48.500176 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-1782aadb-39dc-4e62-99b9-80d357c3fd9d admin admin] The token cache is being invalidate because project a34478698f2744b49e3999d7661b51b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87126) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 20:34:48.500462 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-1782aadb-39dc-4e62-99b9-80d357c3fd9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87126) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:34:48.501076 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG keystone.notifications [None req-1782aadb-39dc-4e62-99b9-80d357c3fd9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87126) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 20:34:48.502572 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: [pid: 87126|app: 0|req: 648/1269] 10.222.0.83 () {58 vars in 1233 bytes} [Wed Jul 27 20:34:48 2022] DELETE /identity/v3/projects/a34478698f2744b49e3999d7661b51b5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 20:34:58.174137 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG dbcounter [-] [87127] Writing DB stats keystone:SELECT=8,keystone:DELETE=1 {{(pid=87127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:34:58.497078 dv-osbrick-849840-5-ceph devstack@keystone.service[87126]: DEBUG dbcounter [-] [87126] Writing DB stats keystone:SELECT=59,keystone:DELETE=11,keystone:INSERT=2 {{(pid=87126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:39:10.463389 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd7262-970c-48d1-84cd-9401d5e15f79 admin admin] Authenticating user token {{(pid=87127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 20:39:10.465327 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-b4cd7262-970c-48d1-84cd-9401d5e15f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:39:10.543628 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd7262-970c-48d1-84cd-9401d5e15f79 admin admin] Validating token access rules against request {{(pid=87127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 20:39:10.602271 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80607ed0-47ae-4708-b1b7-c7c40fb91a9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733839729aa249e0823f24a8e8fb3ffe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75313278ff3747909a57b6f37496d31e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 20:39:10.602834 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80607ed0-47ae-4708-b1b7-c7c40fb91a9a service placement] REQUEST_METHOD: `GET` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 20:39:10.603149 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80607ed0-47ae-4708-b1b7-c7c40fb91a9a service placement] SCRIPT_NAME: `/identity` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 20:39:10.603427 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80607ed0-47ae-4708-b1b7-c7c40fb91a9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 20:39:10.605176 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.fernet_utils [None req-80607ed0-47ae-4708-b1b7-c7c40fb91a9a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 20:39:10.617198 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80607ed0-47ae-4708-b1b7-c7c40fb91a9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 20:39:10.618815 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80607ed0-47ae-4708-b1b7-c7c40fb91a9a service placement] RBAC: Authorization granted {{(pid=87127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 20:39:10.628855 dv-osbrick-849840-5-ceph devstack@keystone.service[87127]: [pid: 87127|app: 0|req: 622/1270] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 27 20:39:10 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)